Jul 03 17:32:26.817486 ip-10-0-137-100 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 03 17:32:26.817498 ip-10-0-137-100 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 03 17:32:26.817508 ip-10-0-137-100 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 03 17:32:26.817825 ip-10-0-137-100 systemd[1]: Failed to start Kubernetes Kubelet. Jul 03 17:32:37.037051 ip-10-0-137-100 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 03 17:32:37.037074 ip-10-0-137-100 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a0caf00ac1c648328830e5c8cf94477c -- Jul 03 17:34:15.565911 ip-10-0-137-100 systemd[1]: Starting Kubernetes Kubelet... Jul 03 17:34:15.947182 ip-10-0-137-100 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 17:34:15.947182 ip-10-0-137-100 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 17:34:15.947182 ip-10-0-137-100 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 17:34:15.947182 ip-10-0-137-100 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 17:34:15.947182 ip-10-0-137-100 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 17:34:15.948225 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.948143 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 17:34:15.952940 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952916 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:15.952940 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952938 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:15.952940 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952941 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:15.952940 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952944 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952947 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952951 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952953 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952956 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952958 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952961 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952964 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952966 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952968 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952971 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952973 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952976 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952978 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952981 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952983 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952992 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952994 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.952997 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:15.953088 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953003 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953007 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953010 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953013 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953015 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953018 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953020 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953023 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953025 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953029 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953032 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953034 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953037 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953040 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953042 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953046 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953049 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953052 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953054 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953057 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:15.953565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953060 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953063 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953065 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953067 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953070 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953074 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953078 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953081 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953084 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953086 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953089 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953091 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953094 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953097 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953100 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953102 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953105 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953107 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953110 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953112 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:15.954049 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953115 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953118 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953121 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953123 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953126 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953129 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953131 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953135 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953139 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953142 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953145 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953150 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953152 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953155 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953157 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953160 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953163 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953165 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953167 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:15.954543 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953170 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953173 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953175 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953178 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953181 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953183 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953186 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953188 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953191 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953193 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953195 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953198 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953200 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953203 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953206 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953208 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953211 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953213 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953956 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:15.954995 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953962 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953967 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953971 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953974 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953977 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953980 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953983 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953986 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953989 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953991 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953994 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953997 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.953999 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954003 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954006 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954009 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954012 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954015 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954017 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:15.955517 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954020 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954023 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954025 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954027 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954030 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954032 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954035 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954038 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954040 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954043 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954045 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954048 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954050 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954053 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954056 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954059 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954061 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954064 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954067 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954069 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:15.955989 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954071 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954074 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954076 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954079 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954081 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954083 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954086 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954088 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954091 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954094 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954096 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954099 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954101 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954104 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954106 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954108 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954111 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954113 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954115 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954119 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:15.956495 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954124 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954127 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954129 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954132 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954135 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954137 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954140 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954142 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954145 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954147 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954150 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954153 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954156 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954158 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954160 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954163 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954165 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954168 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954170 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:15.956980 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954172 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954175 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954178 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954180 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954183 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954185 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954188 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954190 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954193 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954196 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954198 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954201 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954203 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954208 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954210 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954213 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954215 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954218 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954221 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954223 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954655 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:15.957474 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954661 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954663 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954666 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954669 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954672 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954675 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954678 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954680 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954683 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954686 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954689 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954692 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954694 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954696 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954699 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954702 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954704 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954707 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954709 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954711 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:15.957979 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954714 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954716 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954719 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954721 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954725 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954728 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954731 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954733 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954736 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954738 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954741 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954743 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954746 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954748 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954750 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954755 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954760 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954763 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954767 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:15.958487 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954770 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954773 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954776 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954779 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954782 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954784 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954787 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954789 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954792 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954794 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954796 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954799 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954801 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954803 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954806 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954808 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954811 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954815 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954817 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954820 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:15.958945 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954823 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954826 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954828 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954830 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954833 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954835 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954838 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954840 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954844 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954846 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954849 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954852 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954854 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954859 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954862 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954865 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954867 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954870 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954873 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:15.959475 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954876 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954878 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954880 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954883 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954885 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954888 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954892 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954895 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954897 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954900 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954903 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954906 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954908 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954911 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954913 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954916 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954918 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954920 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954923 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.954925 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:15.959926 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.954999 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955011 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955018 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955022 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955027 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955030 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955034 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955038 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955041 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955044 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955047 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955051 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955053 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955056 2580 flags.go:64] FLAG: --cgroup-root="" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955060 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955063 2580 flags.go:64] FLAG: --client-ca-file="" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955066 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955069 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955073 2580 flags.go:64] FLAG: --cluster-domain="" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955075 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955079 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955082 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955086 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955090 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 17:34:15.960449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955092 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955095 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955098 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955101 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955104 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955107 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955110 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955113 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955117 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955120 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955123 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955126 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955129 2580 flags.go:64] FLAG: --enable-server="true" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955132 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955138 2580 flags.go:64] FLAG: --event-burst="100" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955141 2580 flags.go:64] FLAG: --event-qps="50" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955144 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955147 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955149 2580 flags.go:64] FLAG: --eviction-hard="" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955153 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955156 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955158 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955161 2580 flags.go:64] FLAG: --eviction-soft="" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955164 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955167 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 17:34:15.961017 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955169 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955172 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955175 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955177 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955180 2580 flags.go:64] FLAG: --feature-gates="" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955186 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955189 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955192 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955194 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955198 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955201 2580 flags.go:64] FLAG: --help="false" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955203 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-100.ec2.internal" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955206 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955209 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955212 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955216 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955219 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955222 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955224 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955227 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955230 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955233 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955236 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955239 2580 flags.go:64] FLAG: --kube-reserved="" Jul 03 17:34:15.961644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955242 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955262 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955266 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955268 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955271 2580 flags.go:64] FLAG: --lock-file="" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955274 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955277 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955280 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955285 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955288 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955291 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955293 2580 flags.go:64] FLAG: --logging-format="text" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955296 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955301 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955304 2580 flags.go:64] FLAG: --manifest-url="" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955306 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955311 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955313 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955317 2580 flags.go:64] FLAG: --max-pods="110" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955320 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955323 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955326 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955329 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955332 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955335 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 17:34:15.962233 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955337 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955346 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955349 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955352 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955354 2580 flags.go:64] FLAG: --pod-cidr="" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955358 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955363 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955366 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955369 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955372 2580 flags.go:64] FLAG: --port="10250" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955375 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955378 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-031baef709e4cd3e3" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955381 2580 flags.go:64] FLAG: --qos-reserved="" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955384 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955388 2580 flags.go:64] FLAG: --register-node="true" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955390 2580 flags.go:64] FLAG: --register-with-taints="" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955394 2580 flags.go:64] FLAG: --registry-burst="10" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955396 2580 flags.go:64] FLAG: --registry-qps="5" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955399 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955402 2580 flags.go:64] FLAG: --reserved-memory="" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955405 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955409 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955412 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955415 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955418 2580 flags.go:64] FLAG: --runonce="false" Jul 03 17:34:15.962861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955420 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955423 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955426 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955429 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955431 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955434 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955437 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955440 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955443 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955446 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955449 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955451 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955454 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955458 2580 flags.go:64] FLAG: --system-cgroups="" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955461 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955466 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955468 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955471 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955475 2580 flags.go:64] FLAG: --tls-min-version="" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955477 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955480 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955484 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955486 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955490 2580 flags.go:64] FLAG: --v="2" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955493 2580 flags.go:64] FLAG: --version="false" Jul 03 17:34:15.964034 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955497 2580 flags.go:64] FLAG: --vmodule="" Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955501 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955504 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955627 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955632 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955636 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955638 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955641 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955644 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955646 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955649 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955651 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955654 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955656 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955659 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955661 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955664 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955666 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955668 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:15.964693 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955671 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955673 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955676 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955679 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955681 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955684 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955686 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955689 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955691 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955695 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955698 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955700 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955703 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955705 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955707 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955710 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955714 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955716 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955718 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:15.965167 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955721 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955725 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955728 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955731 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955733 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955736 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955738 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955741 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955744 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955746 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955748 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955751 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955753 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955756 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955758 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955760 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955763 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955766 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955768 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:15.965656 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955771 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955773 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955776 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955780 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955782 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955784 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955787 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955789 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955791 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955794 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955798 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955800 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955803 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955805 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955808 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955810 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955813 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955815 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955818 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955820 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:15.966113 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955823 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955825 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955828 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955830 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955833 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955835 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955838 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955840 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955843 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955845 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955848 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955850 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955853 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955855 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955858 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955861 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955864 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955866 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955869 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955871 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:15.966611 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955873 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955876 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955879 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955883 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.955886 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.955892 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.964126 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.964141 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.964941 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.964950 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965012 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965018 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965021 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965025 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965027 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:15.967090 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965030 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965033 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965036 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965038 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965041 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965044 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965048 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965052 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965055 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965058 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965061 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965065 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965068 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965071 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965073 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965077 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965080 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965082 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965085 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:15.967488 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965088 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965091 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965093 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965096 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965099 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965102 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965105 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965108 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965111 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965113 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965115 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965118 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965121 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965123 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965125 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965128 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965130 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965132 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965135 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:15.967951 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965137 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965139 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965142 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965145 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965148 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965150 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965152 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965155 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965157 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965160 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965162 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965165 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965167 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965170 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965173 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965176 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965178 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965181 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965185 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965188 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:15.968510 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965190 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965193 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965195 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965198 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965200 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965203 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965205 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965208 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965210 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965214 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965217 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965220 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965223 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965225 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965228 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965230 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965233 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965235 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965238 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:15.969007 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965240 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965243 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965263 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965267 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965269 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965271 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965274 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965276 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965279 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965282 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965285 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965287 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965290 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965293 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965295 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965298 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:15.969483 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965300 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.965305 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965415 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965420 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965424 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965428 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965432 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965435 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965438 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965440 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965443 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965446 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965448 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965451 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965455 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:15.969950 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965457 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965460 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965462 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965465 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965468 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965471 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965473 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965476 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965478 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965480 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965483 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965485 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965487 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965490 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965493 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965495 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965498 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965500 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965502 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:15.970353 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965505 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965507 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965510 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965514 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965516 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965519 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965521 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965524 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965526 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965529 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965531 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965534 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965536 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965539 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965541 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965544 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965546 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965549 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965552 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:15.970830 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965554 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965556 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965559 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965561 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965564 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965566 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965569 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965572 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965574 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965577 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965579 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965582 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965584 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965587 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965589 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965592 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965594 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965596 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965599 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:15.971360 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965603 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965606 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965608 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965610 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965613 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965615 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965618 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965620 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965623 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965626 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965628 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965631 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965633 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965636 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965638 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965640 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965643 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965645 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965647 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965650 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:15.972111 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965653 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965655 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965658 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965660 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965663 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965665 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965668 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965671 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:15.965673 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.965678 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.965787 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.969534 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.971154 2580 server.go:1019] "Starting client certificate rotation" Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.971280 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 17:34:15.972811 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.971333 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 17:34:15.973870 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.973849 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 17:34:15.978540 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.978512 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 17:34:15.988752 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.988730 2580 log.go:25] "Validated CRI v1 runtime API" Jul 03 17:34:15.991349 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.991335 2580 log.go:25] "Validated CRI v1 image API" Jul 03 17:34:15.992169 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.992156 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 17:34:15.995953 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.995933 2580 fs.go:135] Filesystem UUIDs: map[193b4fc3-0066-4c10-9b5f-475d85c840dc:/dev/nvme0n1p3 38e666df-7b0d-4842-9667-c5d5d0f6be6a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 03 17:34:15.996024 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:15.995952 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 17:34:16.000366 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.000347 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 17:34:16.000904 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.000793 2580 manager.go:216] Machine: {Timestamp:2026-07-03 17:34:15.999401346 +0000 UTC m=+0.319657287 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100869 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c7bce2ce204bd95be5de6875dbc05 SystemUUID:ec2c7bce-2ce2-04bd-95be-5de6875dbc05 BootID:a0caf00a-c1c6-4832-8830-e5c8cf94477c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:b6:52:2d:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:b6:52:2d:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:a0:5f:47:db:f0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 17:34:16.000904 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.000900 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 17:34:16.001029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.000989 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 17:34:16.004284 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.004262 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 17:34:16.004424 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.004287 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 17:34:16.005146 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.005136 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 17:34:16.005180 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.005149 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 17:34:16.005180 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.005157 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 17:34:16.005804 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.005794 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 17:34:16.007613 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.007603 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 17:34:16.012066 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.012052 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 03 17:34:16.012366 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.012356 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 17:34:16.012401 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.012388 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 03 17:34:16.012401 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.012398 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 17:34:16.012456 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.012410 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 17:34:16.012456 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.012421 2580 kubelet.go:398] "Adding apiserver pod source" Jul 03 17:34:16.012456 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.012430 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 17:34:16.014419 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.014396 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 17:34:16.014419 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.014429 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 17:34:16.017302 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.017282 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 17:34:16.019563 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.019550 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 17:34:16.019618 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.019581 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 17:34:16.021151 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021139 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021155 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021161 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021167 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021175 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021181 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021189 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021194 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 17:34:16.021200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021201 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 17:34:16.021428 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021207 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 17:34:16.021428 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021215 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 17:34:16.021428 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.021232 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 17:34:16.022180 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.022168 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 17:34:16.022180 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.022180 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 17:34:16.024004 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.023986 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 17:34:16.024479 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.024458 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 17:34:16.024792 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.024771 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 17:34:16.025725 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.025711 2580 server.go:1268] "Started kubelet" Jul 03 17:34:16.025844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.025797 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 17:34:16.026522 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.026467 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 17:34:16.026631 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.026541 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 17:34:16.026532 ip-10-0-137-100 systemd[1]: Started Kubernetes Kubelet. Jul 03 17:34:16.027788 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.027772 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 03 17:34:16.028815 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.028795 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 17:34:16.030362 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.030342 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9br6k" Jul 03 17:34:16.031497 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.031479 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 17:34:16.036758 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.036744 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 17:34:16.036803 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.036755 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 17:34:16.036858 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.036842 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.037525 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.037504 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 17:34:16.037525 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.037528 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 17:34:16.037678 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.037666 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 03 17:34:16.037728 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.037679 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 03 17:34:16.037728 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.037722 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 17:34:16.039131 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.039108 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9br6k" Jul 03 17:34:16.039964 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.039416 2580 factory.go:153] Registering CRI-O factory Jul 03 17:34:16.040177 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.040079 2580 factory.go:223] Registration of the crio container factory successfully Jul 03 17:34:16.040177 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.040143 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 17:34:16.040177 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.040154 2580 factory.go:55] Registering systemd factory Jul 03 17:34:16.040177 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.040162 2580 factory.go:223] Registration of the systemd container factory successfully Jul 03 17:34:16.040516 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.040184 2580 factory.go:103] Registering Raw factory Jul 03 17:34:16.040516 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.040199 2580 manager.go:1196] Started watching for new ooms in manager Jul 03 17:34:16.040905 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.040887 2580 manager.go:349] Starting recovery of all containers Jul 03 17:34:16.043167 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.041850 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-100.ec2.internal.18bed80dbe63cfb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-100.ec2.internal,UID:ip-10-0-137-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-100.ec2.internal,},FirstTimestamp:2026-07-03 17:34:16.025681845 +0000 UTC m=+0.345937786,LastTimestamp:2026-07-03 17:34:16.025681845 +0000 UTC m=+0.345937786,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-100.ec2.internal,}" Jul 03 17:34:16.043311 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.043221 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 03 17:34:16.043392 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.043372 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 03 17:34:16.052895 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.052736 2580 manager.go:354] Recovery completed Jul 03 17:34:16.057142 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.057130 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:16.059062 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.059045 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:16.059147 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.059080 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:16.059147 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.059096 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:16.059658 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.059644 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 17:34:16.059724 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.059658 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:16.059724 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.059658 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 17:34:16.059804 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.059734 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 03 17:34:16.060399 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.060382 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:16.060462 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.060410 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:16.060462 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.060421 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:16.061630 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.061619 2580 policy_none.go:49] "None policy: Start" Jul 03 17:34:16.061672 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.061634 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 17:34:16.061672 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.061644 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 17:34:16.063511 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.063501 2580 policy_none.go:47] "Start" Jul 03 17:34:16.094921 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.094855 2580 manager.go:337] "Starting Device Plugin manager" Jul 03 17:34:16.094921 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.094889 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 17:34:16.094921 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.094903 2580 server.go:87] "Starting device plugin registration server" Jul 03 17:34:16.120979 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.095180 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 17:34:16.120979 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.095191 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 17:34:16.120979 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.095303 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 17:34:16.120979 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.095370 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 17:34:16.120979 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.095380 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 17:34:16.120979 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.095864 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 17:34:16.120979 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.095908 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.195547 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.195496 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:16.196562 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.196542 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:16.196675 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.196584 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:16.196675 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.196601 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:16.196675 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.196634 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.200491 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.200428 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 17:34:16.201818 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.201799 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 17:34:16.201887 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.201848 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 17:34:16.201887 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.201876 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 17:34:16.201973 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.201914 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 17:34:16.206461 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.206443 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:16.209434 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.209414 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.209522 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.209438 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-100.ec2.internal\": node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.254967 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.254933 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.302747 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.302713 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal"] Jul 03 17:34:16.302895 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.302784 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:16.304464 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.304447 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:16.304542 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.304486 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:16.304542 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.304497 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:16.307011 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.306996 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:16.307117 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.307175 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307130 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:16.307691 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307673 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:16.307781 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307700 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:16.307781 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307710 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:16.307781 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307681 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:16.307921 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307785 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:16.307921 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.307805 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:16.310048 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.310030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.310132 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.310064 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:16.310822 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.310803 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:16.310908 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.310831 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:16.310908 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.310840 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:16.339509 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.339480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/029f0faa0b0023277c3e141aa247e3e5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-100.ec2.internal\" (UID: \"029f0faa0b0023277c3e141aa247e3e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.339509 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.339509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85de7380fc3770d63c4e94d4b8b84daa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"85de7380fc3770d63c4e94d4b8b84daa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.339685 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.339529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85de7380fc3770d63c4e94d4b8b84daa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"85de7380fc3770d63c4e94d4b8b84daa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.353053 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.353033 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-100.ec2.internal\" not found" node="ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.355103 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.355084 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.357373 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.357359 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-100.ec2.internal\" not found" node="ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.440043 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.440010 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85de7380fc3770d63c4e94d4b8b84daa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"85de7380fc3770d63c4e94d4b8b84daa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.440043 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.439978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85de7380fc3770d63c4e94d4b8b84daa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"85de7380fc3770d63c4e94d4b8b84daa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.440284 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.440105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85de7380fc3770d63c4e94d4b8b84daa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"85de7380fc3770d63c4e94d4b8b84daa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.440284 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.440138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/029f0faa0b0023277c3e141aa247e3e5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-100.ec2.internal\" (UID: \"029f0faa0b0023277c3e141aa247e3e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.440284 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.440176 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85de7380fc3770d63c4e94d4b8b84daa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal\" (UID: \"85de7380fc3770d63c4e94d4b8b84daa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.440284 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.440197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/029f0faa0b0023277c3e141aa247e3e5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-100.ec2.internal\" (UID: \"029f0faa0b0023277c3e141aa247e3e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.455477 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.455403 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.555873 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.555833 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.656411 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.656370 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.656411 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.656402 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.661311 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.661109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:16.757206 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.757116 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.857738 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.857708 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.902364 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.902341 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:16.957814 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:16.957783 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:16.970075 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.970044 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 17:34:16.970226 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.970207 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 17:34:16.970317 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:16.970236 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 17:34:17.048525 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.048437 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 17:29:16 +0000 UTC" deadline="2028-01-03 18:25:29.013881707 +0000 UTC" Jul 03 17:34:17.048525 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.048471 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13176h51m11.965413674s" Jul 03 17:34:17.058624 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:17.058590 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-100.ec2.internal\" not found" Jul 03 17:34:17.090334 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.090300 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:17.137618 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.137585 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" Jul 03 17:34:17.152423 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.152397 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 17:34:17.153951 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.153938 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" Jul 03 17:34:17.171135 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.171106 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 17:34:17.279704 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.278551 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:17.323560 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:17.323525 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029f0faa0b0023277c3e141aa247e3e5.slice/crio-fd7ca35be91971aabd6403bb55d5e48d479fb190e72cdbf5b9d001e9c5c653ea WatchSource:0}: Error finding container fd7ca35be91971aabd6403bb55d5e48d479fb190e72cdbf5b9d001e9c5c653ea: Status 404 returned error can't find the container with id fd7ca35be91971aabd6403bb55d5e48d479fb190e72cdbf5b9d001e9c5c653ea Jul 03 17:34:17.328442 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:17.328420 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 17:34:17.334984 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:17.334963 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85de7380fc3770d63c4e94d4b8b84daa.slice/crio-7e9e4cf2863c5a68d18726915054f11431b5b4e87156a1b021cda380f038e7e9 WatchSource:0}: Error finding container 7e9e4cf2863c5a68d18726915054f11431b5b4e87156a1b021cda380f038e7e9: Status 404 returned error can't find the container with id 7e9e4cf2863c5a68d18726915054f11431b5b4e87156a1b021cda380f038e7e9 Jul 03 17:34:18.014198 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.014167 2580 apiserver.go:52] "Watching apiserver" Jul 03 17:34:18.022768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.022744 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 17:34:18.023139 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.023115 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-wfslb","openshift-ovn-kubernetes/ovnkube-node-hwhft","kube-system/global-pull-secret-syncer-5t7jg","kube-system/konnectivity-agent-zdtk6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6","openshift-cluster-node-tuning-operator/tuned-w7sct","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal","openshift-multus/multus-additional-cni-plugins-kskdn","openshift-multus/multus-zmm5f","openshift-network-operator/iptables-alerter-cjmsq","kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal","openshift-dns/node-resolver-w8pnp","openshift-image-registry/node-ca-xwq7g","openshift-multus/network-metrics-daemon-4zbsx"] Jul 03 17:34:18.025654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.025632 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:18.025745 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.025716 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:18.027938 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.027916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.030085 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.030065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.030178 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.030135 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:18.031364 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.031345 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 17:34:18.031457 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.031412 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 17:34:18.032218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.032060 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 17:34:18.032218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.032110 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l2gw6\"" Jul 03 17:34:18.032218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.032060 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 17:34:18.032394 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.032342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.032522 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.032501 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 17:34:18.033633 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.033617 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 17:34:18.034749 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.034734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.035192 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.035175 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 17:34:18.036491 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.036474 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5lg26\"" Jul 03 17:34:18.036614 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.036560 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 17:34:18.036816 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.036800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.037275 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.037242 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 17:34:18.037387 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.037368 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 17:34:18.037437 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.037383 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-968g4\"" Jul 03 17:34:18.037758 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.037737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 17:34:18.040703 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.039919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.040703 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.040597 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 17:34:18.041123 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.041099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 17:34:18.041924 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.041898 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p4j6p\"" Jul 03 17:34:18.042020 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.041948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.042505 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.042313 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 17:34:18.042625 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.042609 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:34:18.042625 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.042618 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m7fwv\"" Jul 03 17:34:18.044575 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.044556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.046880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.046778 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 17:34:18.046880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.046799 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 17:34:18.047098 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.047052 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.047098 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.047086 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 17:34:18.047359 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.047341 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q46f9\"" Jul 03 17:34:18.048342 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-registration-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.048417 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysctl-d\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.048417 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-host\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.048417 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.048417 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4408f24f-2560-4ef2-baf9-995c82169851-konnectivity-ca\") pod \"konnectivity-agent-zdtk6\" (UID: \"4408f24f-2560-4ef2-baf9-995c82169851\") " pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-sys-fs\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048501 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-cnibin\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-etc-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw2ls\" (UniqueName: \"kubernetes.io/projected/3b3a6808-d8bd-4fa0-a24b-c5669266743b-kube-api-access-dw2ls\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-kubernetes\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-slash\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovn-node-metrics-cert\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-cni-binary-copy\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.048621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-tuned\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysconfig\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-ovn\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048696 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovnkube-config\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfrst\" (UniqueName: \"kubernetes.io/projected/6f227b70-4c03-4104-aeb5-aa4171f93107-kube-api-access-kfrst\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-var-lib-kubelet\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e30be182-0566-46d3-b5e0-7b1d64b85375-tmp\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdvp\" (UniqueName: \"kubernetes.io/projected/e30be182-0566-46d3-b5e0-7b1d64b85375-kube-api-access-zfdvp\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-systemd-units\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048959 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-modprobe-d\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.048979 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-run\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-run-netns\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8002d112-70a9-4ece-9123-5194f18b80b2-dbus\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.049064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-log-socket\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-socket-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8002d112-70a9-4ece-9123-5194f18b80b2-kubelet-config\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049139 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-device-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049162 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dttzl\" (UniqueName: \"kubernetes.io/projected/cb007eaa-4728-4f63-85af-11ee88d805b4-kube-api-access-dttzl\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-node-log\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-systemd\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-lib-modules\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4408f24f-2560-4ef2-baf9-995c82169851-agent-certs\") pod \"konnectivity-agent-zdtk6\" (UID: \"4408f24f-2560-4ef2-baf9-995c82169851\") " pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysctl-conf\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-system-cni-dir\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-os-release\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.049843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049410 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-sys\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-var-lib-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-cni-netd\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-env-overrides\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovnkube-script-lib\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-kubelet\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-systemd\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-cni-bin\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.050582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.049936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.052331 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.052311 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:18.052419 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.052384 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:18.062905 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.062888 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 17:34:18.063522 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.063158 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 17:34:18.063625 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.063540 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-52nhm\"" Jul 03 17:34:18.063685 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.063649 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pch26\"" Jul 03 17:34:18.063728 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.063686 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 17:34:18.063844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.063808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 17:34:18.063844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.063818 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 17:34:18.064120 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.064101 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fwbzd\"" Jul 03 17:34:18.064207 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.064103 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 17:34:18.064285 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.064143 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 17:34:18.077864 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.077839 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 17:34:18.139427 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.139401 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 17:34:18.150097 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-cni-multus\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-sys\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-var-lib-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150203 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-sys\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150262 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-cni-netd\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150286 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150288 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-var-lib-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150287 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-env-overrides\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovnkube-script-lib\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-k8s-cni-cncf-io\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150341 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-cni-netd\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150358 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f06db276-6fb0-40c0-8165-7435c32bce56-tmp-dir\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-kubelet\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-systemd\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-cni-bin\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-registration-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l4qb\" (UniqueName: \"kubernetes.io/projected/499876cc-475d-4596-abbe-41169a803961-kube-api-access-2l4qb\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-host-slash\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-hostroot\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-conf-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysctl-d\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-host\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.150702 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150619 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhpm\" (UniqueName: \"kubernetes.io/projected/6842f315-d716-4374-8fea-3e9904bedea0-kube-api-access-vrhpm\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1c51fdf-6465-495e-b7f0-4b669d806963-cni-binary-copy\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4408f24f-2560-4ef2-baf9-995c82169851-konnectivity-ca\") pod \"konnectivity-agent-zdtk6\" (UID: \"4408f24f-2560-4ef2-baf9-995c82169851\") " pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-sys-fs\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-cnibin\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-multus-certs\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-etc-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw2ls\" (UniqueName: \"kubernetes.io/projected/3b3a6808-d8bd-4fa0-a24b-c5669266743b-kube-api-access-dw2ls\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150774 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-env-overrides\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f06db276-6fb0-40c0-8165-7435c32bce56-hosts-file\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-kubernetes\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-slash\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovn-node-metrics-cert\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-cni-binary-copy\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.151517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-tuned\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysconfig\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-ovn\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovnkube-config\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.150968 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovnkube-script-lib\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151008 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-cni-bin\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfrst\" (UniqueName: \"kubernetes.io/projected/6f227b70-4c03-4104-aeb5-aa4171f93107-kube-api-access-kfrst\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6842f315-d716-4374-8fea-3e9904bedea0-serviceca\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.151068 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-cnibin\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.151123 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret podName:8002d112-70a9-4ece-9123-5194f18b80b2 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:18.651108261 +0000 UTC m=+2.971364189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret") pod "global-pull-secret-syncer-5t7jg" (UID: "8002d112-70a9-4ece-9123-5194f18b80b2") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151136 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-daemon-config\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-var-lib-kubelet\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.152313 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e30be182-0566-46d3-b5e0-7b1d64b85375-tmp\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdvp\" (UniqueName: \"kubernetes.io/projected/e30be182-0566-46d3-b5e0-7b1d64b85375-kube-api-access-zfdvp\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-systemd-units\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-iptables-alerter-script\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-os-release\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151265 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-socket-dir-parent\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151287 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-modprobe-d\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-run\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-run-netns\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4408f24f-2560-4ef2-baf9-995c82169851-konnectivity-ca\") pod \"konnectivity-agent-zdtk6\" (UID: \"4408f24f-2560-4ef2-baf9-995c82169851\") " pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151488 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysconfig\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151506 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-run\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151513 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-ovn\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151525 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-var-lib-kubelet\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151540 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-slash\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151542 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151557 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovnkube-config\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.153196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8002d112-70a9-4ece-9123-5194f18b80b2-dbus\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151582 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-systemd-units\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbc68\" (UniqueName: \"kubernetes.io/projected/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-kube-api-access-rbc68\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151608 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-kubelet\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151623 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-registration-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6842f315-d716-4374-8fea-3e9904bedea0-host\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-cni-bin\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-kubelet\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-log-socket\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151717 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysctl-d\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-kubernetes\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-socket-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151564 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-run-systemd\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151676 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-host-run-netns\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151757 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-sys-fs\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-log-socket\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151805 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 17:34:18.154012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151866 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-host\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151884 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-socket-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151884 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8002d112-70a9-4ece-9123-5194f18b80b2-dbus\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151913 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-cnibin\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151933 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-etc-openvswitch\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.151969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-modprobe-d\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8002d112-70a9-4ece-9123-5194f18b80b2-kubelet-config\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-cni-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152289 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8002d112-70a9-4ece-9123-5194f18b80b2-kubelet-config\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-device-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152322 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dttzl\" (UniqueName: \"kubernetes.io/projected/cb007eaa-4728-4f63-85af-11ee88d805b4-kube-api-access-dttzl\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-etc-kubernetes\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvvbb\" (UniqueName: \"kubernetes.io/projected/f06db276-6fb0-40c0-8165-7435c32bce56-kube-api-access-wvvbb\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152396 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-device-dir\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.154662 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-node-log\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-systemd\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-system-cni-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-lib-modules\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4408f24f-2560-4ef2-baf9-995c82169851-agent-certs\") pod \"konnectivity-agent-zdtk6\" (UID: \"4408f24f-2560-4ef2-baf9-995c82169851\") " pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-netns\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f42cp\" (UniqueName: \"kubernetes.io/projected/f1c51fdf-6465-495e-b7f0-4b669d806963-kube-api-access-f42cp\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysctl-conf\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-system-cni-dir\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-os-release\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152652 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b3a6808-d8bd-4fa0-a24b-c5669266743b-node-log\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152668 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-lib-modules\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152568 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-cni-binary-copy\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-system-cni-dir\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152749 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f227b70-4c03-4104-aeb5-aa4171f93107-os-release\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152746 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-systemd\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.155512 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152788 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-sysctl-conf\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.156329 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.152821 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb007eaa-4728-4f63-85af-11ee88d805b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.156462 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.156438 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f227b70-4c03-4104-aeb5-aa4171f93107-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.159304 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.156623 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e30be182-0566-46d3-b5e0-7b1d64b85375-tmp\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.159304 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.156749 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b3a6808-d8bd-4fa0-a24b-c5669266743b-ovn-node-metrics-cert\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.159778 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.159757 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e30be182-0566-46d3-b5e0-7b1d64b85375-etc-tuned\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.161457 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.161436 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4408f24f-2560-4ef2-baf9-995c82169851-agent-certs\") pod \"konnectivity-agent-zdtk6\" (UID: \"4408f24f-2560-4ef2-baf9-995c82169851\") " pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.184837 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.184809 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:18.184837 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.184836 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:18.184996 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.184850 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7787x for pod openshift-network-diagnostics/network-check-target-wfslb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:18.184996 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.184901 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x podName:05f5a051-aac3-4958-ad99-7407e07eaf54 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:18.684885578 +0000 UTC m=+3.005141519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7787x" (UniqueName: "kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x") pod "network-check-target-wfslb" (UID: "05f5a051-aac3-4958-ad99-7407e07eaf54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:18.187517 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.187488 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dttzl\" (UniqueName: \"kubernetes.io/projected/cb007eaa-4728-4f63-85af-11ee88d805b4-kube-api-access-dttzl\") pod \"aws-ebs-csi-driver-node-4p9w6\" (UID: \"cb007eaa-4728-4f63-85af-11ee88d805b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.187738 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.187712 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw2ls\" (UniqueName: \"kubernetes.io/projected/3b3a6808-d8bd-4fa0-a24b-c5669266743b-kube-api-access-dw2ls\") pod \"ovnkube-node-hwhft\" (UID: \"3b3a6808-d8bd-4fa0-a24b-c5669266743b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.187946 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.187919 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdvp\" (UniqueName: \"kubernetes.io/projected/e30be182-0566-46d3-b5e0-7b1d64b85375-kube-api-access-zfdvp\") pod \"tuned-w7sct\" (UID: \"e30be182-0566-46d3-b5e0-7b1d64b85375\") " pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.189373 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.189352 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfrst\" (UniqueName: \"kubernetes.io/projected/6f227b70-4c03-4104-aeb5-aa4171f93107-kube-api-access-kfrst\") pod \"multus-additional-cni-plugins-kskdn\" (UID: \"6f227b70-4c03-4104-aeb5-aa4171f93107\") " pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.199840 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.199814 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-28hcx" Jul 03 17:34:18.206609 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.206535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" event={"ID":"029f0faa0b0023277c3e141aa247e3e5","Type":"ContainerStarted","Data":"fd7ca35be91971aabd6403bb55d5e48d479fb190e72cdbf5b9d001e9c5c653ea"} Jul 03 17:34:18.208221 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.207870 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" event={"ID":"85de7380fc3770d63c4e94d4b8b84daa","Type":"ContainerStarted","Data":"7e9e4cf2863c5a68d18726915054f11431b5b4e87156a1b021cda380f038e7e9"} Jul 03 17:34:18.211719 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.211697 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-28hcx" Jul 03 17:34:18.253888 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.253843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-multus-certs\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.253893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f06db276-6fb0-40c0-8165-7435c32bce56-hosts-file\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.253923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6842f315-d716-4374-8fea-3e9904bedea0-serviceca\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.253948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-cnibin\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.253972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-daemon-config\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.253994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-iptables-alerter-script\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-os-release\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-socket-dir-parent\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbc68\" (UniqueName: \"kubernetes.io/projected/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-kube-api-access-rbc68\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.254073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6842f315-d716-4374-8fea-3e9904bedea0-host\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-cni-bin\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-kubelet\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-cni-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-etc-kubernetes\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvvbb\" (UniqueName: \"kubernetes.io/projected/f06db276-6fb0-40c0-8165-7435c32bce56-kube-api-access-wvvbb\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-system-cni-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-netns\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42cp\" (UniqueName: \"kubernetes.io/projected/f1c51fdf-6465-495e-b7f0-4b669d806963-kube-api-access-f42cp\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-cni-multus\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-k8s-cni-cncf-io\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f06db276-6fb0-40c0-8165-7435c32bce56-tmp-dir\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l4qb\" (UniqueName: \"kubernetes.io/projected/499876cc-475d-4596-abbe-41169a803961-kube-api-access-2l4qb\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-host-slash\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-hostroot\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-conf-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254528 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-hostroot\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:18.254582 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhpm\" (UniqueName: \"kubernetes.io/projected/6842f315-d716-4374-8fea-3e9904bedea0-kube-api-access-vrhpm\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.255212 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254578 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-multus-certs\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255212 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1c51fdf-6465-495e-b7f0-4b669d806963-cni-binary-copy\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255212 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.254708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f06db276-6fb0-40c0-8165-7435c32bce56-hosts-file\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.255212 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6842f315-d716-4374-8fea-3e9904bedea0-serviceca\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.255389 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255234 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-cnibin\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255389 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1c51fdf-6465-495e-b7f0-4b669d806963-cni-binary-copy\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255389 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255355 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-os-release\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255532 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255419 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-system-cni-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255532 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255464 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-netns\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255684 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255662 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-cni-multus\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255742 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255724 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-run-k8s-cni-cncf-io\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255792 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255744 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-socket-dir-parent\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255792 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-daemon-config\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.255900 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255825 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6842f315-d716-4374-8fea-3e9904bedea0-host\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.255900 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255875 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-cni-bin\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.256004 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-host-var-lib-kubelet\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.256004 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255984 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-cni-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.256101 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.255990 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f06db276-6fb0-40c0-8165-7435c32bce56-tmp-dir\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.256101 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.256042 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-etc-kubernetes\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.256101 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.256072 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:18.256254 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.256130 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:18.756111201 +0000 UTC m=+3.076367175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:18.256254 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.256245 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1c51fdf-6465-495e-b7f0-4b669d806963-multus-conf-dir\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.256392 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.256299 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-host-slash\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.256392 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.256307 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-iptables-alerter-script\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.274454 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.274378 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhpm\" (UniqueName: \"kubernetes.io/projected/6842f315-d716-4374-8fea-3e9904bedea0-kube-api-access-vrhpm\") pod \"node-ca-xwq7g\" (UID: \"6842f315-d716-4374-8fea-3e9904bedea0\") " pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.274454 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.274443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l4qb\" (UniqueName: \"kubernetes.io/projected/499876cc-475d-4596-abbe-41169a803961-kube-api-access-2l4qb\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:18.276560 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.276535 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbc68\" (UniqueName: \"kubernetes.io/projected/a4bc56d6-8f16-4505-8d2a-610899c7ee9f-kube-api-access-rbc68\") pod \"iptables-alerter-cjmsq\" (UID: \"a4bc56d6-8f16-4505-8d2a-610899c7ee9f\") " pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.276723 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.276588 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42cp\" (UniqueName: \"kubernetes.io/projected/f1c51fdf-6465-495e-b7f0-4b669d806963-kube-api-access-f42cp\") pod \"multus-zmm5f\" (UID: \"f1c51fdf-6465-495e-b7f0-4b669d806963\") " pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.278126 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.278106 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvvbb\" (UniqueName: \"kubernetes.io/projected/f06db276-6fb0-40c0-8165-7435c32bce56-kube-api-access-wvvbb\") pod \"node-resolver-w8pnp\" (UID: \"f06db276-6fb0-40c0-8165-7435c32bce56\") " pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.339449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.339412 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:18.346994 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.346963 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:18.355479 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.355329 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" Jul 03 17:34:18.362139 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.362121 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w7sct" Jul 03 17:34:18.369054 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.369035 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kskdn" Jul 03 17:34:18.380366 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.380337 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zmm5f" Jul 03 17:34:18.388927 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.388906 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cjmsq" Jul 03 17:34:18.394682 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.394661 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w8pnp" Jul 03 17:34:18.401522 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.401503 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xwq7g" Jul 03 17:34:18.479622 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.479591 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:18.657515 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.657420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:18.657687 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.657617 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:18.657768 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.657697 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret podName:8002d112-70a9-4ece-9123-5194f18b80b2 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:19.657674839 +0000 UTC m=+3.977930792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret") pod "global-pull-secret-syncer-5t7jg" (UID: "8002d112-70a9-4ece-9123-5194f18b80b2") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:18.758631 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.758576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:18.758832 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:18.758666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:18.758832 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.758790 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:18.758832 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.758800 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:18.758832 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.758817 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:18.758832 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.758832 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7787x for pod openshift-network-diagnostics/network-check-target-wfslb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:18.759085 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.758877 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:19.758858644 +0000 UTC m=+4.079114580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:18.759085 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:18.758892 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x podName:05f5a051-aac3-4958-ad99-7407e07eaf54 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:19.758885742 +0000 UTC m=+4.079141675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7787x" (UniqueName: "kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x") pod "network-check-target-wfslb" (UID: "05f5a051-aac3-4958-ad99-7407e07eaf54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:19.202368 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:19.202337 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:19.202902 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.202469 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:19.215506 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:19.215467 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 17:29:19 +0000 UTC" deadline="2027-11-28 04:34:59.193586365 +0000 UTC" Jul 03 17:34:19.215506 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:19.215505 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12299h0m39.978085845s" Jul 03 17:34:19.299778 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.299693 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bc56d6_8f16_4505_8d2a_610899c7ee9f.slice/crio-e61e035a2255ce9e975a0989567e0445ffd0077627947cfdfdf3e1c3bffc65a2 WatchSource:0}: Error finding container e61e035a2255ce9e975a0989567e0445ffd0077627947cfdfdf3e1c3bffc65a2: Status 404 returned error can't find the container with id e61e035a2255ce9e975a0989567e0445ffd0077627947cfdfdf3e1c3bffc65a2 Jul 03 17:34:19.301342 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.301278 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6842f315_d716_4374_8fea_3e9904bedea0.slice/crio-b731890c3b203e19db42ea008a0fa144e861b0fc56c5cfa02115430435832503 WatchSource:0}: Error finding container b731890c3b203e19db42ea008a0fa144e861b0fc56c5cfa02115430435832503: Status 404 returned error can't find the container with id b731890c3b203e19db42ea008a0fa144e861b0fc56c5cfa02115430435832503 Jul 03 17:34:19.302145 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.302109 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06db276_6fb0_40c0_8165_7435c32bce56.slice/crio-fda9aac0b54d2c31ca9e4526612e575dba4220ce8542786eba7e6c9451a93fd1 WatchSource:0}: Error finding container fda9aac0b54d2c31ca9e4526612e575dba4220ce8542786eba7e6c9451a93fd1: Status 404 returned error can't find the container with id fda9aac0b54d2c31ca9e4526612e575dba4220ce8542786eba7e6c9451a93fd1 Jul 03 17:34:19.305468 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.305357 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30be182_0566_46d3_b5e0_7b1d64b85375.slice/crio-78337dccd385a9fb2c917d39d0dfe2b7a6e4056df86051465e2a67b80a947809 WatchSource:0}: Error finding container 78337dccd385a9fb2c917d39d0dfe2b7a6e4056df86051465e2a67b80a947809: Status 404 returned error can't find the container with id 78337dccd385a9fb2c917d39d0dfe2b7a6e4056df86051465e2a67b80a947809 Jul 03 17:34:19.305916 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.305891 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c51fdf_6465_495e_b7f0_4b669d806963.slice/crio-c46efb59407a68380809946ca5af9ca0eb94cd185a3e8275517ea44d65e966d0 WatchSource:0}: Error finding container c46efb59407a68380809946ca5af9ca0eb94cd185a3e8275517ea44d65e966d0: Status 404 returned error can't find the container with id c46efb59407a68380809946ca5af9ca0eb94cd185a3e8275517ea44d65e966d0 Jul 03 17:34:19.309440 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.307005 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4408f24f_2560_4ef2_baf9_995c82169851.slice/crio-cde182d586f43c4d038786d7c997172866cc7bcd37c70bd4f8899dc2b4b89d14 WatchSource:0}: Error finding container cde182d586f43c4d038786d7c997172866cc7bcd37c70bd4f8899dc2b4b89d14: Status 404 returned error can't find the container with id cde182d586f43c4d038786d7c997172866cc7bcd37c70bd4f8899dc2b4b89d14 Jul 03 17:34:19.309440 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.308331 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb007eaa_4728_4f63_85af_11ee88d805b4.slice/crio-33d98e20635a607b933cd1e3ddeac6d809813cbe168737dcddec264db06058fb WatchSource:0}: Error finding container 33d98e20635a607b933cd1e3ddeac6d809813cbe168737dcddec264db06058fb: Status 404 returned error can't find the container with id 33d98e20635a607b933cd1e3ddeac6d809813cbe168737dcddec264db06058fb Jul 03 17:34:19.310381 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.310360 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f227b70_4c03_4104_aeb5_aa4171f93107.slice/crio-93a64eb730d084b045a1e15f6084f0aa4cf168f90f5304272ad4edec65dc9ce0 WatchSource:0}: Error finding container 93a64eb730d084b045a1e15f6084f0aa4cf168f90f5304272ad4edec65dc9ce0: Status 404 returned error can't find the container with id 93a64eb730d084b045a1e15f6084f0aa4cf168f90f5304272ad4edec65dc9ce0 Jul 03 17:34:19.311276 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:19.310798 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3a6808_d8bd_4fa0_a24b_c5669266743b.slice/crio-5e303321d698f8008493501826d7903f2ceda1c0695e4647ccff558ce3ab8056 WatchSource:0}: Error finding container 5e303321d698f8008493501826d7903f2ceda1c0695e4647ccff558ce3ab8056: Status 404 returned error can't find the container with id 5e303321d698f8008493501826d7903f2ceda1c0695e4647ccff558ce3ab8056 Jul 03 17:34:19.667715 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:19.667471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:19.667889 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.667648 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:19.667955 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.667894 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret podName:8002d112-70a9-4ece-9123-5194f18b80b2 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:21.667863619 +0000 UTC m=+5.988119563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret") pod "global-pull-secret-syncer-5t7jg" (UID: "8002d112-70a9-4ece-9123-5194f18b80b2") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:19.768156 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:19.768098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:19.768485 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:19.768185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:19.768485 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.768389 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:19.768485 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.768419 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:19.768485 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.768434 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7787x for pod openshift-network-diagnostics/network-check-target-wfslb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:19.768719 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.768498 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x podName:05f5a051-aac3-4958-ad99-7407e07eaf54 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:21.768477931 +0000 UTC m=+6.088733880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7787x" (UniqueName: "kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x") pod "network-check-target-wfslb" (UID: "05f5a051-aac3-4958-ad99-7407e07eaf54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:19.769479 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.768929 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:19.769479 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:19.768980 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:21.768966605 +0000 UTC m=+6.089222558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:20.146769 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.145907 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:20.203537 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.203471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:20.203537 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.203485 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:20.204118 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:20.203615 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:20.204118 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:20.204081 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:20.215720 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.215637 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 17:29:19 +0000 UTC" deadline="2027-12-27 16:27:29.379608076 +0000 UTC" Jul 03 17:34:20.215720 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.215690 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13006h53m9.163922568s" Jul 03 17:34:20.244373 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.243371 2580 generic.go:356] "Generic (PLEG): container finished" podID="85de7380fc3770d63c4e94d4b8b84daa" containerID="f81acc37a4282b7a9878ac103bc28fcf04d9c82740573a80fb90955b4cba5765" exitCode=0 Jul 03 17:34:20.244373 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.243470 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" event={"ID":"85de7380fc3770d63c4e94d4b8b84daa","Type":"ContainerDied","Data":"f81acc37a4282b7a9878ac103bc28fcf04d9c82740573a80fb90955b4cba5765"} Jul 03 17:34:20.262939 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.262900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"5e303321d698f8008493501826d7903f2ceda1c0695e4647ccff558ce3ab8056"} Jul 03 17:34:20.277411 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.277371 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerStarted","Data":"93a64eb730d084b045a1e15f6084f0aa4cf168f90f5304272ad4edec65dc9ce0"} Jul 03 17:34:20.294414 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.294247 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" event={"ID":"cb007eaa-4728-4f63-85af-11ee88d805b4","Type":"ContainerStarted","Data":"33d98e20635a607b933cd1e3ddeac6d809813cbe168737dcddec264db06058fb"} Jul 03 17:34:20.307951 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.307908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w7sct" event={"ID":"e30be182-0566-46d3-b5e0-7b1d64b85375","Type":"ContainerStarted","Data":"78337dccd385a9fb2c917d39d0dfe2b7a6e4056df86051465e2a67b80a947809"} Jul 03 17:34:20.321135 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.321071 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" event={"ID":"029f0faa0b0023277c3e141aa247e3e5","Type":"ContainerStarted","Data":"283a9b53db3a44a39acb41b6e45f14817312cbd946b5c4031fb3c83afc8ed293"} Jul 03 17:34:20.330544 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.330510 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zmm5f" event={"ID":"f1c51fdf-6465-495e-b7f0-4b669d806963","Type":"ContainerStarted","Data":"c46efb59407a68380809946ca5af9ca0eb94cd185a3e8275517ea44d65e966d0"} Jul 03 17:34:20.346393 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.346346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zdtk6" event={"ID":"4408f24f-2560-4ef2-baf9-995c82169851","Type":"ContainerStarted","Data":"cde182d586f43c4d038786d7c997172866cc7bcd37c70bd4f8899dc2b4b89d14"} Jul 03 17:34:20.360697 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.360610 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w8pnp" event={"ID":"f06db276-6fb0-40c0-8165-7435c32bce56","Type":"ContainerStarted","Data":"fda9aac0b54d2c31ca9e4526612e575dba4220ce8542786eba7e6c9451a93fd1"} Jul 03 17:34:20.372375 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.372296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xwq7g" event={"ID":"6842f315-d716-4374-8fea-3e9904bedea0","Type":"ContainerStarted","Data":"b731890c3b203e19db42ea008a0fa144e861b0fc56c5cfa02115430435832503"} Jul 03 17:34:20.375211 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:20.375136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cjmsq" event={"ID":"a4bc56d6-8f16-4505-8d2a-610899c7ee9f","Type":"ContainerStarted","Data":"e61e035a2255ce9e975a0989567e0445ffd0077627947cfdfdf3e1c3bffc65a2"} Jul 03 17:34:21.202515 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:21.202479 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:21.202704 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.202633 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:21.391504 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:21.391415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" event={"ID":"85de7380fc3770d63c4e94d4b8b84daa","Type":"ContainerStarted","Data":"adc05c074df63797f897d44f9412e8b6945fd058bb33cd25b37c54da1b3a7187"} Jul 03 17:34:21.410450 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:21.410380 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-100.ec2.internal" podStartSLOduration=4.410356863 podStartE2EDuration="4.410356863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:20.340830128 +0000 UTC m=+4.661086084" watchObservedRunningTime="2026-07-03 17:34:21.410356863 +0000 UTC m=+5.730612819" Jul 03 17:34:21.685110 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:21.685026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:21.685278 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.685175 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:21.685278 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.685240 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret podName:8002d112-70a9-4ece-9123-5194f18b80b2 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:25.685220429 +0000 UTC m=+10.005476373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret") pod "global-pull-secret-syncer-5t7jg" (UID: "8002d112-70a9-4ece-9123-5194f18b80b2") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:21.785724 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:21.785683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:21.785888 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:21.785777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:21.785972 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.785954 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:21.786043 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.785984 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:21.786043 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.785999 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7787x for pod openshift-network-diagnostics/network-check-target-wfslb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:21.786142 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.786061 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x podName:05f5a051-aac3-4958-ad99-7407e07eaf54 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:25.786041569 +0000 UTC m=+10.106297503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7787x" (UniqueName: "kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x") pod "network-check-target-wfslb" (UID: "05f5a051-aac3-4958-ad99-7407e07eaf54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:21.786521 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.786499 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:21.786629 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:21.786554 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:25.78653891 +0000 UTC m=+10.106794854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:22.202570 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:22.202532 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:22.202748 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:22.202698 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:22.205754 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:22.203122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:22.205754 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:22.203221 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:23.202163 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:23.202125 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:23.202719 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:23.202286 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:24.206828 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:24.206797 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:24.207312 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:24.206929 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:24.207426 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:24.207410 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:24.207561 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:24.207514 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:25.203013 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:25.202682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:25.203013 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.202847 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:25.719904 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:25.719323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:25.719904 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.719509 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:25.719904 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.719581 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret podName:8002d112-70a9-4ece-9123-5194f18b80b2 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:33.71955915 +0000 UTC m=+18.039815094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret") pod "global-pull-secret-syncer-5t7jg" (UID: "8002d112-70a9-4ece-9123-5194f18b80b2") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:25.819946 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:25.819901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:25.820113 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:25.819967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:25.820176 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.820104 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:25.820176 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.820115 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:25.820176 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.820137 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:25.820176 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.820152 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7787x for pod openshift-network-diagnostics/network-check-target-wfslb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:25.820414 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.820192 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:33.820169629 +0000 UTC m=+18.140425577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:25.820414 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:25.820213 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x podName:05f5a051-aac3-4958-ad99-7407e07eaf54 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:33.820203595 +0000 UTC m=+18.140459526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7787x" (UniqueName: "kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x") pod "network-check-target-wfslb" (UID: "05f5a051-aac3-4958-ad99-7407e07eaf54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:26.203583 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:26.203490 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:26.203750 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:26.203626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:26.203750 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:26.203619 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:26.203750 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:26.203710 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:27.202962 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:27.202920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:27.203454 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:27.203064 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:28.202609 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:28.202511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:28.202609 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:28.202530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:28.202902 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:28.202664 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:28.203160 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:28.203133 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:29.203006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:29.202459 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:29.203006 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:29.202600 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:30.202780 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:30.202744 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:30.203187 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:30.202935 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:30.203187 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:30.202985 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:30.203187 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:30.203082 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:31.202567 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:31.202531 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:31.202723 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:31.202643 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:32.202322 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:32.202282 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:32.202788 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:32.202335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:32.202788 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:32.202428 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:32.202788 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:32.202567 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:33.202845 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:33.202807 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:33.203323 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.202962 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:33.783640 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:33.783593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:33.783901 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.783760 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:33.783901 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.783830 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret podName:8002d112-70a9-4ece-9123-5194f18b80b2 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:49.78381363 +0000 UTC m=+34.104069560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret") pod "global-pull-secret-syncer-5t7jg" (UID: "8002d112-70a9-4ece-9123-5194f18b80b2") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:33.884563 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:33.884521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:33.884753 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:33.884618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:33.884753 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.884716 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:33.884753 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.884729 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:33.884753 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.884743 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:33.884930 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.884759 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7787x for pod openshift-network-diagnostics/network-check-target-wfslb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:33.884930 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.884796 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:49.884775776 +0000 UTC m=+34.205031706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:33.884930 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:33.884816 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x podName:05f5a051-aac3-4958-ad99-7407e07eaf54 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:49.884805996 +0000 UTC m=+34.205061926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7787x" (UniqueName: "kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x") pod "network-check-target-wfslb" (UID: "05f5a051-aac3-4958-ad99-7407e07eaf54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:34.202465 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:34.202345 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:34.202621 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:34.202470 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:34.202621 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:34.202529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:34.202729 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:34.202657 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:35.203088 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:35.203054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:35.203602 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:35.203177 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:36.203308 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:36.203274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:36.203801 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:36.203315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:36.203801 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:36.203400 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:36.203801 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:36.203552 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:37.203082 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:37.203046 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:37.203293 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:37.203174 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:38.203090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:38.203056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:38.203578 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:38.203056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:38.203578 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:38.203211 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:38.203578 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:38.203290 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:39.203311 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.202307 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:39.203311 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:39.202597 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:39.428645 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.428486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"c38ba0121a7aea4342b38f81640dc2f26ec72414277c813fd9554fcfe31ea001"} Jul 03 17:34:39.430436 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.430407 2580 generic.go:356] "Generic (PLEG): container finished" podID="6f227b70-4c03-4104-aeb5-aa4171f93107" containerID="32144e026431fdd6e2c376c972beef4bc99c075b0fff4c204a21eefefa3e4feb" exitCode=0 Jul 03 17:34:39.430562 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.430472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerDied","Data":"32144e026431fdd6e2c376c972beef4bc99c075b0fff4c204a21eefefa3e4feb"} Jul 03 17:34:39.433150 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.433126 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" event={"ID":"cb007eaa-4728-4f63-85af-11ee88d805b4","Type":"ContainerStarted","Data":"2ecc529f9dbdd62a75192ede503f075b5f4934cdb197a4010d8fe978511dacba"} Jul 03 17:34:39.435502 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.435477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w7sct" event={"ID":"e30be182-0566-46d3-b5e0-7b1d64b85375","Type":"ContainerStarted","Data":"8ac211a0c67b475c11cbee1cd156d527356516deeb19bf32f83d8db3ec047595"} Jul 03 17:34:39.437791 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.437730 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zmm5f" event={"ID":"f1c51fdf-6465-495e-b7f0-4b669d806963","Type":"ContainerStarted","Data":"81431785513d79155684c04dabca44d351ab2039201fff43385098ecf3cdf250"} Jul 03 17:34:39.439176 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.439138 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zdtk6" event={"ID":"4408f24f-2560-4ef2-baf9-995c82169851","Type":"ContainerStarted","Data":"b4d4516ee401a23a34b6b18d3561aab3dd3ed597ac15d9223af64fc31a57d750"} Jul 03 17:34:39.440689 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.440457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w8pnp" event={"ID":"f06db276-6fb0-40c0-8165-7435c32bce56","Type":"ContainerStarted","Data":"da393854164295d0ba12561a63f55eaad02b42e69f2b28dea764d77039adb91a"} Jul 03 17:34:39.441629 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.441610 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xwq7g" event={"ID":"6842f315-d716-4374-8fea-3e9904bedea0","Type":"ContainerStarted","Data":"9643d6eb7f45875fdbacc02b31a3cbd1fb09236f684af87e24aaacf1f4b1f36f"} Jul 03 17:34:39.458791 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.458471 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-100.ec2.internal" podStartSLOduration=22.458451272 podStartE2EDuration="22.458451272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:21.410751178 +0000 UTC m=+5.731007136" watchObservedRunningTime="2026-07-03 17:34:39.458451272 +0000 UTC m=+23.778707225" Jul 03 17:34:39.484156 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.484104 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zmm5f" podStartSLOduration=2.600565016 podStartE2EDuration="22.484082439s" totalImagesPullingTime="19.883517423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:39.483661959 +0000 UTC m=+23.803917910" watchObservedRunningTime="2026-07-03 17:34:39.484082439 +0000 UTC m=+23.804338390" Jul 03 17:34:39.501793 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.501739 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w8pnp" podStartSLOduration=2.663507499 podStartE2EDuration="22.501723624s" totalImagesPullingTime="19.838216125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:39.501423742 +0000 UTC m=+23.821679694" watchObservedRunningTime="2026-07-03 17:34:39.501723624 +0000 UTC m=+23.821979573" Jul 03 17:34:39.521732 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.521671 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xwq7g" podStartSLOduration=2.6815943300000002 podStartE2EDuration="22.521651707s" totalImagesPullingTime="19.840057377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:39.521114395 +0000 UTC m=+23.841370344" watchObservedRunningTime="2026-07-03 17:34:39.521651707 +0000 UTC m=+23.841907698" Jul 03 17:34:39.572021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.571976 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zdtk6" podStartSLOduration=2.737131859 podStartE2EDuration="22.571957063s" totalImagesPullingTime="19.834825204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:39.549730627 +0000 UTC m=+23.869986577" watchObservedRunningTime="2026-07-03 17:34:39.571957063 +0000 UTC m=+23.892213004" Jul 03 17:34:39.572171 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.572110 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w7sct" podStartSLOduration=2.733556368 podStartE2EDuration="22.572105432s" totalImagesPullingTime="19.838549064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:39.572028577 +0000 UTC m=+23.892284521" watchObservedRunningTime="2026-07-03 17:34:39.572105432 +0000 UTC m=+23.892361383" Jul 03 17:34:39.937111 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.937036 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:39.937699 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:39.937677 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:40.203391 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.203069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:40.203391 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.203100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:40.203391 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:40.203206 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:40.203391 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:40.203303 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:40.446268 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.446023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cjmsq" event={"ID":"a4bc56d6-8f16-4505-8d2a-610899c7ee9f","Type":"ContainerStarted","Data":"0e8d0bd9c603f8d50ab78fe84e1ae34b7b3a1a77718d972ed34d84a62525e634"} Jul 03 17:34:40.450216 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.450181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"c28d4e7b3665db2719849ab6295204c1f21d22234cb360c9ea629f4c199f664e"} Jul 03 17:34:40.450375 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.450283 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"6a253fd390a236ed5451a3fbc72714b211929434a4c3f2388a0503444ce3dbbf"} Jul 03 17:34:40.450375 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.450338 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"cc99e4e9d403939039130b8ce40f05a450a179324ca75da0e47e86c895799162"} Jul 03 17:34:40.450488 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.450384 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"f5695a8f42f4234fae9dcbcc7b6d778b7d77785b95c12fe966d2091eeafc0116"} Jul 03 17:34:40.450488 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.450435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"afad5792ce18b5c327902b7cfe13cd164d6660fab57e5eea751042382971d80a"} Jul 03 17:34:40.766048 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:40.766023 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 17:34:41.113061 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:41.112957 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T17:34:40.766043041Z","UUID":"a51046c5-48d0-465d-ba40-e68012f89711","Handler":null,"Name":"","Endpoint":""} Jul 03 17:34:41.114556 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:41.114531 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 17:34:41.114684 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:41.114567 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 17:34:41.202924 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:41.202893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:41.203103 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:41.203018 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:41.453608 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:41.453546 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 03 17:34:41.453608 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:41.453570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" event={"ID":"cb007eaa-4728-4f63-85af-11ee88d805b4","Type":"ContainerStarted","Data":"2b324c42c8a0c76a817765dd2cd7b2ef49c5c6fb3f24c23b22d7ce2133d145a4"} Jul 03 17:34:42.203320 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:42.203209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:42.203544 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:42.203222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:42.203544 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:42.203366 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:42.203544 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:42.203414 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:42.459962 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:42.459705 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"85dc6936831cd0f13087a1cfc575b7844353748f6c730c4876d8f7efd73f7e64"} Jul 03 17:34:42.464109 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:42.464073 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" event={"ID":"cb007eaa-4728-4f63-85af-11ee88d805b4","Type":"ContainerStarted","Data":"0d16c372f2b3ebf307853b090f80083c28a9f23bb0c88b4ab745213927be8813"} Jul 03 17:34:42.488860 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:42.488812 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cjmsq" podStartSLOduration=5.642608129 podStartE2EDuration="25.488795955s" totalImagesPullingTime="19.846187826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:40.463629648 +0000 UTC m=+24.783885599" watchObservedRunningTime="2026-07-03 17:34:42.488795955 +0000 UTC m=+26.809051905" Jul 03 17:34:43.202523 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:43.202489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:43.202745 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:43.202613 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:44.202928 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.202898 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:44.203397 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.202902 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:44.203397 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:44.203027 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:44.203397 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:44.203135 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:44.473458 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.473363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" event={"ID":"3b3a6808-d8bd-4fa0-a24b-c5669266743b","Type":"ContainerStarted","Data":"a12b45173c751d7b6141215cc2c345e1697dccfbe9b196bb55374519389ef27e"} Jul 03 17:34:44.473851 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.473727 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:44.473851 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.473801 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:44.491658 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.491575 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:44.515021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.514969 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4p9w6" podStartSLOduration=5.3217727759999995 podStartE2EDuration="27.514952459s" totalImagesPullingTime="22.193179683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:42.488604812 +0000 UTC m=+26.808860761" watchObservedRunningTime="2026-07-03 17:34:44.514952459 +0000 UTC m=+28.835208452" Jul 03 17:34:44.515475 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:44.515451 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" podStartSLOduration=7.590013074 podStartE2EDuration="27.515442464s" totalImagesPullingTime="19.92542939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:44.51278979 +0000 UTC m=+28.833045740" watchObservedRunningTime="2026-07-03 17:34:44.515442464 +0000 UTC m=+28.835698415" Jul 03 17:34:45.202940 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:45.202762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:45.203844 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:45.203025 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:45.477864 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:45.477791 2580 generic.go:356] "Generic (PLEG): container finished" podID="6f227b70-4c03-4104-aeb5-aa4171f93107" containerID="6dfb72ea857d2082da7be9c137a92c7cb180eab2cd118ac6c4687dde2d1ba494" exitCode=0 Jul 03 17:34:45.478045 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:45.477892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerDied","Data":"6dfb72ea857d2082da7be9c137a92c7cb180eab2cd118ac6c4687dde2d1ba494"} Jul 03 17:34:45.478045 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:45.477956 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:45.494142 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:45.494108 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:34:46.206686 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.206558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:46.206686 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.206623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:46.206686 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:46.206706 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:46.207488 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:46.206823 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:46.755772 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.755555 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfslb"] Jul 03 17:34:46.755907 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.755836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:46.755962 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:46.755938 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:46.757802 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.757767 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4zbsx"] Jul 03 17:34:46.757922 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.757893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:46.758039 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:46.758015 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:46.758456 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.758441 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t7jg"] Jul 03 17:34:46.758521 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.758511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:46.758591 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:46.758575 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:46.859783 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.859744 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:46.859979 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.859872 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 03 17:34:46.860532 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:46.860510 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zdtk6" Jul 03 17:34:47.486108 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:47.486079 2580 generic.go:356] "Generic (PLEG): container finished" podID="6f227b70-4c03-4104-aeb5-aa4171f93107" containerID="8916d0798933b2ecedcbf46dc17d0a5bc70dadf301fdbff70b8aa40d65c016e3" exitCode=0 Jul 03 17:34:47.486628 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:47.486167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerDied","Data":"8916d0798933b2ecedcbf46dc17d0a5bc70dadf301fdbff70b8aa40d65c016e3"} Jul 03 17:34:48.206439 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:48.206405 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:48.206599 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:48.206519 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:48.206599 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:48.206543 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:48.206599 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:48.206532 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:48.206722 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:48.206640 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:48.206722 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:48.206701 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:49.493012 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:49.492980 2580 generic.go:356] "Generic (PLEG): container finished" podID="6f227b70-4c03-4104-aeb5-aa4171f93107" containerID="dadd0f60b9e9e61edf6ccf030f816f3e343200b595cd85633dd2d7ce8cce554d" exitCode=0 Jul 03 17:34:49.493617 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:49.493033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerDied","Data":"dadd0f60b9e9e61edf6ccf030f816f3e343200b595cd85633dd2d7ce8cce554d"} Jul 03 17:34:49.800501 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:49.800420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:49.800645 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.800567 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:49.800645 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.800635 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret podName:8002d112-70a9-4ece-9123-5194f18b80b2 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:21.800618696 +0000 UTC m=+66.120874624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret") pod "global-pull-secret-syncer-5t7jg" (UID: "8002d112-70a9-4ece-9123-5194f18b80b2") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:49.901716 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:49.901685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:49.901871 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:49.901737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:49.901871 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.901835 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:49.901871 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.901852 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:49.901871 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.901867 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:49.902037 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.901876 2580 projected.go:196] Error preparing data for projected volume kube-api-access-7787x for pod openshift-network-diagnostics/network-check-target-wfslb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:49.902037 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.901896 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:21.90188247 +0000 UTC m=+66.222138399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:49.902037 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:49.901916 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x podName:05f5a051-aac3-4958-ad99-7407e07eaf54 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:21.901904355 +0000 UTC m=+66.222160299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7787x" (UniqueName: "kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x") pod "network-check-target-wfslb" (UID: "05f5a051-aac3-4958-ad99-7407e07eaf54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:50.203073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:50.203037 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:50.203073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:50.203057 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:50.203344 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:50.203163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:50.203344 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:50.203176 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t7jg" podUID="8002d112-70a9-4ece-9123-5194f18b80b2" Jul 03 17:34:50.203344 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:50.203288 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfslb" podUID="05f5a051-aac3-4958-ad99-7407e07eaf54" Jul 03 17:34:50.203506 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:50.203373 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zbsx" podUID="499876cc-475d-4596-abbe-41169a803961" Jul 03 17:34:52.005360 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.005282 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-100.ec2.internal" event="NodeReady" Jul 03 17:34:52.005807 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.005444 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 17:34:52.075530 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.075493 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qlw9b"] Jul 03 17:34:52.078927 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.078900 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qcb5q"] Jul 03 17:34:52.079040 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.079023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.081779 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.081751 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 17:34:52.082481 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.082464 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 17:34:52.083141 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.083118 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.087584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.087454 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h6r6p\"" Jul 03 17:34:52.087584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.087468 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 17:34:52.087584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.087485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kcqds\"" Jul 03 17:34:52.087584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.087569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 17:34:52.087584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.087581 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 17:34:52.113226 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.113188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qlw9b"] Jul 03 17:34:52.114115 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.114092 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qcb5q"] Jul 03 17:34:52.202832 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.202799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:34:52.202832 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.202821 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:34:52.203073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.202894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:34:52.210220 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.210192 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 17:34:52.212302 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.212283 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 17:34:52.212443 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.212422 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2zdg\"" Jul 03 17:34:52.212511 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.212481 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f5bmn\"" Jul 03 17:34:52.212569 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.212512 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 17:34:52.217638 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.217612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-tmp-dir\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.217746 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.217673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5213ab89-a837-4e59-8088-6496cb842bcb-cert\") pod \"ingress-canary-qcb5q\" (UID: \"5213ab89-a837-4e59-8088-6496cb842bcb\") " pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.217746 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.217724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6rg5\" (UniqueName: \"kubernetes.io/projected/5213ab89-a837-4e59-8088-6496cb842bcb-kube-api-access-l6rg5\") pod \"ingress-canary-qcb5q\" (UID: \"5213ab89-a837-4e59-8088-6496cb842bcb\") " pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.217853 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.217761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-config-volume\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.217853 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.217795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.217853 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.217842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw2jp\" (UniqueName: \"kubernetes.io/projected/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-kube-api-access-nw2jp\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.222485 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.222470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 17:34:52.318274 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6rg5\" (UniqueName: \"kubernetes.io/projected/5213ab89-a837-4e59-8088-6496cb842bcb-kube-api-access-l6rg5\") pod \"ingress-canary-qcb5q\" (UID: \"5213ab89-a837-4e59-8088-6496cb842bcb\") " pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.318274 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-config-volume\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.318274 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.318533 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw2jp\" (UniqueName: \"kubernetes.io/projected/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-kube-api-access-nw2jp\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.318533 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-tmp-dir\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.318533 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5213ab89-a837-4e59-8088-6496cb842bcb-cert\") pod \"ingress-canary-qcb5q\" (UID: \"5213ab89-a837-4e59-8088-6496cb842bcb\") " pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.318533 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:52.318445 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:34:52.318533 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:52.318514 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls podName:bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e nodeName:}" failed. No retries permitted until 2026-07-03 17:34:52.818493164 +0000 UTC m=+37.138749096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls") pod "dns-default-qlw9b" (UID: "bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e") : secret "dns-default-metrics-tls" not found Jul 03 17:34:52.318775 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318752 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-tmp-dir\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.318861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.318840 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-config-volume\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.323027 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.323004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5213ab89-a837-4e59-8088-6496cb842bcb-cert\") pod \"ingress-canary-qcb5q\" (UID: \"5213ab89-a837-4e59-8088-6496cb842bcb\") " pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.348435 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.348410 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw2jp\" (UniqueName: \"kubernetes.io/projected/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-kube-api-access-nw2jp\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.349788 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.349756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6rg5\" (UniqueName: \"kubernetes.io/projected/5213ab89-a837-4e59-8088-6496cb842bcb-kube-api-access-l6rg5\") pod \"ingress-canary-qcb5q\" (UID: \"5213ab89-a837-4e59-8088-6496cb842bcb\") " pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.399603 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.399565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qcb5q" Jul 03 17:34:52.820867 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:52.820678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:52.821037 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:52.820838 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:34:52.821037 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:52.820985 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls podName:bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e nodeName:}" failed. No retries permitted until 2026-07-03 17:34:53.820957109 +0000 UTC m=+38.141213055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls") pod "dns-default-qlw9b" (UID: "bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e") : secret "dns-default-metrics-tls" not found Jul 03 17:34:53.717064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:53.717034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qcb5q"] Jul 03 17:34:53.724620 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:34:53.724593 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5213ab89_a837_4e59_8088_6496cb842bcb.slice/crio-9c32a899a93f39a6ade178bd817400e99825f43bc2c8b069c9ad34594f67854d WatchSource:0}: Error finding container 9c32a899a93f39a6ade178bd817400e99825f43bc2c8b069c9ad34594f67854d: Status 404 returned error can't find the container with id 9c32a899a93f39a6ade178bd817400e99825f43bc2c8b069c9ad34594f67854d Jul 03 17:34:53.829751 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:53.829720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:53.829916 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:53.829897 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:34:53.829994 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:53.829981 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls podName:bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e nodeName:}" failed. No retries permitted until 2026-07-03 17:34:55.829959153 +0000 UTC m=+40.150215086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls") pod "dns-default-qlw9b" (UID: "bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e") : secret "dns-default-metrics-tls" not found Jul 03 17:34:54.507990 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:54.507955 2580 generic.go:356] "Generic (PLEG): container finished" podID="6f227b70-4c03-4104-aeb5-aa4171f93107" containerID="cc05c6ad3b3da6e3e0e63bf22ee1c513d05d367f3e3581d72aed1c3b5bd3f841" exitCode=0 Jul 03 17:34:54.508177 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:54.508044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerDied","Data":"cc05c6ad3b3da6e3e0e63bf22ee1c513d05d367f3e3581d72aed1c3b5bd3f841"} Jul 03 17:34:54.509172 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:54.509142 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qcb5q" event={"ID":"5213ab89-a837-4e59-8088-6496cb842bcb","Type":"ContainerStarted","Data":"9c32a899a93f39a6ade178bd817400e99825f43bc2c8b069c9ad34594f67854d"} Jul 03 17:34:55.515030 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:55.514983 2580 generic.go:356] "Generic (PLEG): container finished" podID="6f227b70-4c03-4104-aeb5-aa4171f93107" containerID="60dd64bf70ef6450575477186cfe51604c4c94c549606eeaa9242f4bd20d1511" exitCode=0 Jul 03 17:34:55.515532 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:55.515062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerDied","Data":"60dd64bf70ef6450575477186cfe51604c4c94c549606eeaa9242f4bd20d1511"} Jul 03 17:34:55.847473 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:55.847381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:55.847622 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:55.847561 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:34:55.847670 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:55.847643 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls podName:bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e nodeName:}" failed. No retries permitted until 2026-07-03 17:34:59.84762588 +0000 UTC m=+44.167881813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls") pod "dns-default-qlw9b" (UID: "bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e") : secret "dns-default-metrics-tls" not found Jul 03 17:34:56.523172 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:56.523134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kskdn" event={"ID":"6f227b70-4c03-4104-aeb5-aa4171f93107","Type":"ContainerStarted","Data":"a545e336ef7a2720234ea62535a03a664c155f9522e59e16877db145cb12d40a"} Jul 03 17:34:56.524536 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:56.524511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qcb5q" event={"ID":"5213ab89-a837-4e59-8088-6496cb842bcb","Type":"ContainerStarted","Data":"a67ffab91b04c6953da9ffb11704916b4557cb2c8bb4235329c41513e9c4630a"} Jul 03 17:34:56.550129 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:56.550079 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kskdn" podStartSLOduration=8.512671676 podStartE2EDuration="39.550065055s" totalImagesPullingTime="31.037393379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:56.549313153 +0000 UTC m=+40.869569103" watchObservedRunningTime="2026-07-03 17:34:56.550065055 +0000 UTC m=+40.870321005" Jul 03 17:34:59.876061 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:34:59.876014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:34:59.876593 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:59.876195 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:34:59.876593 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:34:59.876302 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls podName:bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:07.876280765 +0000 UTC m=+52.196536693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls") pod "dns-default-qlw9b" (UID: "bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e") : secret "dns-default-metrics-tls" not found Jul 03 17:35:07.932682 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:07.932637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:35:07.933160 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:07.932784 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:07.933160 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:07.932846 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls podName:bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:23.932831008 +0000 UTC m=+68.253086936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls") pod "dns-default-qlw9b" (UID: "bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e") : secret "dns-default-metrics-tls" not found Jul 03 17:35:17.503179 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:17.503149 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwhft" Jul 03 17:35:17.551990 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:17.551926 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qcb5q" podStartSLOduration=23.006563715 podStartE2EDuration="25.551910081s" totalImagesPullingTime="2.545346366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:56.568393765 +0000 UTC m=+40.888649714" watchObservedRunningTime="2026-07-03 17:35:17.551910081 +0000 UTC m=+61.872166031" Jul 03 17:35:21.829496 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.829450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:35:21.832014 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.831996 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 17:35:21.843612 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.843581 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8002d112-70a9-4ece-9123-5194f18b80b2-original-pull-secret\") pod \"global-pull-secret-syncer-5t7jg\" (UID: \"8002d112-70a9-4ece-9123-5194f18b80b2\") " pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:35:21.922412 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.922378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t7jg" Jul 03 17:35:21.930292 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.930240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:35:21.930407 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.930326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:35:21.933127 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.933101 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 17:35:21.933458 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.933442 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 17:35:21.940515 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:21.940491 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 03 17:35:21.940638 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:21.940562 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs podName:499876cc-475d-4596-abbe-41169a803961 nodeName:}" failed. No retries permitted until 2026-07-03 17:36:25.940539141 +0000 UTC m=+130.260795086 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs") pod "network-metrics-daemon-4zbsx" (UID: "499876cc-475d-4596-abbe-41169a803961") : secret "metrics-daemon-secret" not found Jul 03 17:35:21.942964 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.942942 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 17:35:21.953729 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:21.953695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7787x\" (UniqueName: \"kubernetes.io/projected/05f5a051-aac3-4958-ad99-7407e07eaf54-kube-api-access-7787x\") pod \"network-check-target-wfslb\" (UID: \"05f5a051-aac3-4958-ad99-7407e07eaf54\") " pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:35:22.047703 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.047673 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t7jg"] Jul 03 17:35:22.051592 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:22.051557 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8002d112_70a9_4ece_9123_5194f18b80b2.slice/crio-bfdf81a624d96884763e906c05e1c42f9abe7dc79f2d82d08f94bd8baa0267de WatchSource:0}: Error finding container bfdf81a624d96884763e906c05e1c42f9abe7dc79f2d82d08f94bd8baa0267de: Status 404 returned error can't find the container with id bfdf81a624d96884763e906c05e1c42f9abe7dc79f2d82d08f94bd8baa0267de Jul 03 17:35:22.216985 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.216953 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f5bmn\"" Jul 03 17:35:22.224964 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.224942 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:35:22.344737 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.344531 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfslb"] Jul 03 17:35:22.347080 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:22.347054 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f5a051_aac3_4958_ad99_7407e07eaf54.slice/crio-6fafb08a895302c16d8a764d95027dbb9456a15fbe71192a7a294bf6dfa294f0 WatchSource:0}: Error finding container 6fafb08a895302c16d8a764d95027dbb9456a15fbe71192a7a294bf6dfa294f0: Status 404 returned error can't find the container with id 6fafb08a895302c16d8a764d95027dbb9456a15fbe71192a7a294bf6dfa294f0 Jul 03 17:35:22.440751 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.440718 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-864f59f9d9-266vv"] Jul 03 17:35:22.442808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.442793 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.448934 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.448876 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 03 17:35:22.449214 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.449196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 03 17:35:22.449383 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.449286 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5872z\"" Jul 03 17:35:22.449383 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.449293 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 17:35:22.449803 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.449746 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 17:35:22.449913 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.449830 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 03 17:35:22.450097 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.450082 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 03 17:35:22.457773 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.457751 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-864f59f9d9-266vv"] Jul 03 17:35:22.589467 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.589382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfslb" event={"ID":"05f5a051-aac3-4958-ad99-7407e07eaf54","Type":"ContainerStarted","Data":"6fafb08a895302c16d8a764d95027dbb9456a15fbe71192a7a294bf6dfa294f0"} Jul 03 17:35:22.590598 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.590571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t7jg" event={"ID":"8002d112-70a9-4ece-9123-5194f18b80b2","Type":"ContainerStarted","Data":"bfdf81a624d96884763e906c05e1c42f9abe7dc79f2d82d08f94bd8baa0267de"} Jul 03 17:35:22.634947 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.634890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.634947 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.634954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-stats-auth\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.635195 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.634999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.635195 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.635022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-default-certificate\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.635195 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.635043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkjl5\" (UniqueName: \"kubernetes.io/projected/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-kube-api-access-zkjl5\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.652101 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.652065 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl"] Jul 03 17:35:22.654458 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.654436 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl"] Jul 03 17:35:22.654589 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.654573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.656307 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.656286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.656822 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.656804 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 03 17:35:22.656913 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.656884 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 03 17:35:22.657162 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.657145 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:35:22.657294 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.657169 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6wjv8\"" Jul 03 17:35:22.657294 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.657187 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 03 17:35:22.658148 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.658133 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 03 17:35:22.658401 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.658383 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 03 17:35:22.658565 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.658544 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:35:22.658790 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.658774 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5nckd\"" Jul 03 17:35:22.658940 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.658926 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 03 17:35:22.669868 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.669846 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl"] Jul 03 17:35:22.674925 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.674904 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl"] Jul 03 17:35:22.735846 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.735808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.736035 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.735852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-default-certificate\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.736035 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.735883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkjl5\" (UniqueName: \"kubernetes.io/projected/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-kube-api-access-zkjl5\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.736035 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.735967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.736035 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:22.735991 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:22.736244 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:22.736078 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:23.236055322 +0000 UTC m=+67.556311263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : secret "router-metrics-certs-default" not found Jul 03 17:35:22.736244 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.735995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-stats-auth\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.736493 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:22.736328 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:23.236308501 +0000 UTC m=+67.556564467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:22.738784 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.738761 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-stats-auth\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.738888 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.738786 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-default-certificate\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.756935 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.756904 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkjl5\" (UniqueName: \"kubernetes.io/projected/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-kube-api-access-zkjl5\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:22.757206 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.757183 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7"] Jul 03 17:35:22.759180 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.759158 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:22.762372 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.762086 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 03 17:35:22.762372 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.762197 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 03 17:35:22.762372 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.762095 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:35:22.762568 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.762549 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8tbjd\"" Jul 03 17:35:22.775508 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.775393 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7"] Jul 03 17:35:22.837687 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.837653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb584\" (UniqueName: \"kubernetes.io/projected/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-kube-api-access-xb584\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.837687 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.837693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/914a1642-a8b6-438e-a099-db30e0692413-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.838129 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.837723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/914a1642-a8b6-438e-a099-db30e0692413-config\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.838129 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.837786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.838129 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.837816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.838129 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.837832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m6hf\" (UniqueName: \"kubernetes.io/projected/914a1642-a8b6-438e-a099-db30e0692413-kube-api-access-4m6hf\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.938515 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.938693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.938693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m6hf\" (UniqueName: \"kubernetes.io/projected/914a1642-a8b6-438e-a099-db30e0692413-kube-api-access-4m6hf\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.938693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:22.938693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggtn\" (UniqueName: \"kubernetes.io/projected/9050e371-68a9-427b-9509-248eb93ea86d-kube-api-access-hggtn\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:22.938693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb584\" (UniqueName: \"kubernetes.io/projected/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-kube-api-access-xb584\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.938693 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/914a1642-a8b6-438e-a099-db30e0692413-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.939015 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.938716 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/914a1642-a8b6-438e-a099-db30e0692413-config\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.939321 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.939298 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/914a1642-a8b6-438e-a099-db30e0692413-config\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.939514 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.939495 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.942180 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.942134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/914a1642-a8b6-438e-a099-db30e0692413-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.943197 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.943173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.950715 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.950681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m6hf\" (UniqueName: \"kubernetes.io/projected/914a1642-a8b6-438e-a099-db30e0692413-kube-api-access-4m6hf\") pod \"service-ca-operator-5d46d9ffd4-bgmxl\" (UID: \"914a1642-a8b6-438e-a099-db30e0692413\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:22.951047 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.951025 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb584\" (UniqueName: \"kubernetes.io/projected/465b40bf-15d5-4b5c-87ae-cf9791f66c6e-kube-api-access-xb584\") pod \"kube-storage-version-migrator-operator-846bf668f7-dtfdl\" (UID: \"465b40bf-15d5-4b5c-87ae-cf9791f66c6e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.967654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.967613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" Jul 03 17:35:22.975637 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:22.975608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" Jul 03 17:35:23.039366 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.039273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggtn\" (UniqueName: \"kubernetes.io/projected/9050e371-68a9-427b-9509-248eb93ea86d-kube-api-access-hggtn\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:23.039483 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.039425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:23.039916 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.039590 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:23.039916 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.039673 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls podName:9050e371-68a9-427b-9509-248eb93ea86d nodeName:}" failed. No retries permitted until 2026-07-03 17:35:23.539652355 +0000 UTC m=+67.859908285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-g8hw7" (UID: "9050e371-68a9-427b-9509-248eb93ea86d") : secret "samples-operator-tls" not found Jul 03 17:35:23.052483 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.052192 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggtn\" (UniqueName: \"kubernetes.io/projected/9050e371-68a9-427b-9509-248eb93ea86d-kube-api-access-hggtn\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:23.135609 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.135576 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl"] Jul 03 17:35:23.140158 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:23.140124 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465b40bf_15d5_4b5c_87ae_cf9791f66c6e.slice/crio-4c5efba608fb1f3bd50f611ef11fa0888cb4a9ffff91b0d49298edd0219f275f WatchSource:0}: Error finding container 4c5efba608fb1f3bd50f611ef11fa0888cb4a9ffff91b0d49298edd0219f275f: Status 404 returned error can't find the container with id 4c5efba608fb1f3bd50f611ef11fa0888cb4a9ffff91b0d49298edd0219f275f Jul 03 17:35:23.150448 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.150292 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl"] Jul 03 17:35:23.153505 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:23.153478 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914a1642_a8b6_438e_a099_db30e0692413.slice/crio-7bc15b7db945b96b4b80463c907802558aa5ef265678551ee259e4d0fb30b7b8 WatchSource:0}: Error finding container 7bc15b7db945b96b4b80463c907802558aa5ef265678551ee259e4d0fb30b7b8: Status 404 returned error can't find the container with id 7bc15b7db945b96b4b80463c907802558aa5ef265678551ee259e4d0fb30b7b8 Jul 03 17:35:23.240866 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.240784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:23.240866 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.240850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:23.241053 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.240994 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:23.241094 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.241058 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:24.241036245 +0000 UTC m=+68.561292177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : secret "router-metrics-certs-default" not found Jul 03 17:35:23.241471 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.241459 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:24.241442387 +0000 UTC m=+68.561698332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:23.543534 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.543452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:23.543787 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.543644 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:23.543787 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.543696 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls podName:9050e371-68a9-427b-9509-248eb93ea86d nodeName:}" failed. No retries permitted until 2026-07-03 17:35:24.543681882 +0000 UTC m=+68.863937810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-g8hw7" (UID: "9050e371-68a9-427b-9509-248eb93ea86d") : secret "samples-operator-tls" not found Jul 03 17:35:23.600695 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.600564 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" event={"ID":"914a1642-a8b6-438e-a099-db30e0692413","Type":"ContainerStarted","Data":"7bc15b7db945b96b4b80463c907802558aa5ef265678551ee259e4d0fb30b7b8"} Jul 03 17:35:23.602527 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.602462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" event={"ID":"465b40bf-15d5-4b5c-87ae-cf9791f66c6e","Type":"ContainerStarted","Data":"4c5efba608fb1f3bd50f611ef11fa0888cb4a9ffff91b0d49298edd0219f275f"} Jul 03 17:35:23.947552 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:23.947429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:35:23.948024 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.947600 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:23.948024 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:23.947660 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls podName:bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:55.947641566 +0000 UTC m=+100.267897496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls") pod "dns-default-qlw9b" (UID: "bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e") : secret "dns-default-metrics-tls" not found Jul 03 17:35:24.250133 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:24.249905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:24.250133 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:24.249984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:24.250133 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:24.250129 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:24.250422 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:24.250190 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:26.250173183 +0000 UTC m=+70.570429115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : secret "router-metrics-certs-default" not found Jul 03 17:35:24.250655 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:24.250635 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:26.250616469 +0000 UTC m=+70.570872402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:24.553480 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:24.553362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:24.553670 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:24.553526 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:24.553670 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:24.553595 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls podName:9050e371-68a9-427b-9509-248eb93ea86d nodeName:}" failed. No retries permitted until 2026-07-03 17:35:26.553575479 +0000 UTC m=+70.873831424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-g8hw7" (UID: "9050e371-68a9-427b-9509-248eb93ea86d") : secret "samples-operator-tls" not found Jul 03 17:35:26.266806 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:26.266765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:26.267232 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:26.266878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:26.267232 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:26.266919 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:26.267232 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:26.266986 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:30.266966487 +0000 UTC m=+74.587222423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : secret "router-metrics-certs-default" not found Jul 03 17:35:26.267232 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:26.267002 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:30.266995089 +0000 UTC m=+74.587251018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:26.569314 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:26.569201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:26.569465 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:26.569374 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:26.569465 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:26.569446 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls podName:9050e371-68a9-427b-9509-248eb93ea86d nodeName:}" failed. No retries permitted until 2026-07-03 17:35:30.569429353 +0000 UTC m=+74.889685285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-g8hw7" (UID: "9050e371-68a9-427b-9509-248eb93ea86d") : secret "samples-operator-tls" not found Jul 03 17:35:27.524289 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.524227 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ndjsz"] Jul 03 17:35:27.526630 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.526610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.533318 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.533290 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 17:35:27.533450 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.533347 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 17:35:27.533545 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.533522 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x42bh\"" Jul 03 17:35:27.540864 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.540846 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 17:35:27.542144 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.542124 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 17:35:27.558664 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.558625 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ndjsz"] Jul 03 17:35:27.578624 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.578597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vw9\" (UniqueName: \"kubernetes.io/projected/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-api-access-44vw9\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.578791 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.578636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd67405f-d619-4fb8-b8cd-d82c417071a5-crio-socket\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.578791 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.578717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.578888 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.578841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd67405f-d619-4fb8-b8cd-d82c417071a5-data-volume\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.578888 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.578867 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680117 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.680081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd67405f-d619-4fb8-b8cd-d82c417071a5-data-volume\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680323 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.680123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680323 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.680173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vw9\" (UniqueName: \"kubernetes.io/projected/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-api-access-44vw9\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680323 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.680199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd67405f-d619-4fb8-b8cd-d82c417071a5-crio-socket\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680323 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.680317 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd67405f-d619-4fb8-b8cd-d82c417071a5-crio-socket\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680535 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:27.680391 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:27.680535 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:27.680464 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:28.180442556 +0000 UTC m=+72.500698524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:27.680535 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.680513 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd67405f-d619-4fb8-b8cd-d82c417071a5-data-volume\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680677 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.680557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:27.680677 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:27.680653 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:27.680757 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:27.680719 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:28.180702562 +0000 UTC m=+72.500958489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : configmap "kube-rbac-proxy" not found Jul 03 17:35:27.691327 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:27.691296 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vw9\" (UniqueName: \"kubernetes.io/projected/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-api-access-44vw9\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:28.185300 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.185238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:28.185494 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.185338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:28.185494 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:28.185411 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:28.185494 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:28.185428 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:28.185494 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:28.185490 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:29.185469105 +0000 UTC m=+73.505725042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:28.185665 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:28.185508 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:29.185501164 +0000 UTC m=+73.505757091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : configmap "kube-rbac-proxy" not found Jul 03 17:35:28.620229 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.620197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" event={"ID":"914a1642-a8b6-438e-a099-db30e0692413","Type":"ContainerStarted","Data":"28669a9530353848445e03f10c1d4ad0f56bc5d36423ae025c508a9d206aad00"} Jul 03 17:35:28.622472 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.622384 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" event={"ID":"465b40bf-15d5-4b5c-87ae-cf9791f66c6e","Type":"ContainerStarted","Data":"8540f986aabbaa607765019bc28eaa28afc1ee4de42334a33e9dfc5a98693d13"} Jul 03 17:35:28.624762 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.624356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfslb" event={"ID":"05f5a051-aac3-4958-ad99-7407e07eaf54","Type":"ContainerStarted","Data":"0c6c63a6a06a913cbc5e14afe52719850937bea075561fe833ef0a670875ad9a"} Jul 03 17:35:28.624762 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.624428 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:35:28.643685 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.643620 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" podStartSLOduration=1.2827781489999999 podStartE2EDuration="6.643599554s" totalImagesPullingTime="5.360821405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:28.642974846 +0000 UTC m=+72.963230808" watchObservedRunningTime="2026-07-03 17:35:28.643599554 +0000 UTC m=+72.963855505" Jul 03 17:35:28.676105 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.676038 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wfslb" podStartSLOduration=65.502012404 podStartE2EDuration="1m11.676016996s" totalImagesPullingTime="6.174004592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:28.674089431 +0000 UTC m=+72.994345383" watchObservedRunningTime="2026-07-03 17:35:28.676016996 +0000 UTC m=+72.996272948" Jul 03 17:35:28.704264 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:28.704185 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" podStartSLOduration=1.333407762 podStartE2EDuration="6.704162971s" totalImagesPullingTime="5.370755209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:28.703915798 +0000 UTC m=+73.024171750" watchObservedRunningTime="2026-07-03 17:35:28.704162971 +0000 UTC m=+73.024418924" Jul 03 17:35:29.192835 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:29.192801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:29.193021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:29.192870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:29.193021 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:29.192951 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:29.193021 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:29.192980 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:29.193139 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:29.193029 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:31.193015458 +0000 UTC m=+75.513271386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:29.193139 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:29.193042 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:31.193036245 +0000 UTC m=+75.513292173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : configmap "kube-rbac-proxy" not found Jul 03 17:35:29.481028 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:29.480954 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w8pnp_f06db276-6fb0-40c0-8165-7435c32bce56/dns-node-resolver/0.log" Jul 03 17:35:29.628961 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:29.628921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t7jg" event={"ID":"8002d112-70a9-4ece-9123-5194f18b80b2","Type":"ContainerStarted","Data":"1f76efb2132e94c91c00672873bd2019a77d35054eee6926096bde3addba0051"} Jul 03 17:35:29.646338 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:29.646286 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5t7jg" podStartSLOduration=66.17231028 podStartE2EDuration="1m12.646242635s" totalImagesPullingTime="6.473932355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:29.64594027 +0000 UTC m=+73.966196221" watchObservedRunningTime="2026-07-03 17:35:29.646242635 +0000 UTC m=+73.966498585" Jul 03 17:35:30.273380 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.273344 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5"] Jul 03 17:35:30.275990 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.275969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" Jul 03 17:35:30.281535 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.281507 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 03 17:35:30.281641 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.281542 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 03 17:35:30.282401 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.282383 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z588j\"" Jul 03 17:35:30.295646 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.295618 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5"] Jul 03 17:35:30.301771 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.301748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:30.301920 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.301791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fxzj\" (UniqueName: \"kubernetes.io/projected/73dbf323-e337-4460-867a-b7044141a7a4-kube-api-access-5fxzj\") pod \"migrator-d57d58cc9-9thc5\" (UID: \"73dbf323-e337-4460-867a-b7044141a7a4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" Jul 03 17:35:30.301920 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.301860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:30.302016 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:30.301914 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:30.302016 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:30.301975 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:38.301961255 +0000 UTC m=+82.622217188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:30.302016 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:30.301989 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:38.301983064 +0000 UTC m=+82.622238992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : secret "router-metrics-certs-default" not found Jul 03 17:35:30.402523 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.402481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fxzj\" (UniqueName: \"kubernetes.io/projected/73dbf323-e337-4460-867a-b7044141a7a4-kube-api-access-5fxzj\") pod \"migrator-d57d58cc9-9thc5\" (UID: \"73dbf323-e337-4460-867a-b7044141a7a4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" Jul 03 17:35:30.413011 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.412982 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fxzj\" (UniqueName: \"kubernetes.io/projected/73dbf323-e337-4460-867a-b7044141a7a4-kube-api-access-5fxzj\") pod \"migrator-d57d58cc9-9thc5\" (UID: \"73dbf323-e337-4460-867a-b7044141a7a4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" Jul 03 17:35:30.489332 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.489302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xwq7g_6842f315-d716-4374-8fea-3e9904bedea0/node-ca/0.log" Jul 03 17:35:30.584408 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.584342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" Jul 03 17:35:30.605029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.604997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:30.605169 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:30.605149 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:30.605242 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:30.605232 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls podName:9050e371-68a9-427b-9509-248eb93ea86d nodeName:}" failed. No retries permitted until 2026-07-03 17:35:38.605210642 +0000 UTC m=+82.925466573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-g8hw7" (UID: "9050e371-68a9-427b-9509-248eb93ea86d") : secret "samples-operator-tls" not found Jul 03 17:35:30.720782 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:30.720750 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5"] Jul 03 17:35:30.721244 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:30.721222 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dbf323_e337_4460_867a_b7044141a7a4.slice/crio-0b9fb8fc4435e00367ffaf20dd088c3dfc778c541bbb7df21a091b89fe07569e WatchSource:0}: Error finding container 0b9fb8fc4435e00367ffaf20dd088c3dfc778c541bbb7df21a091b89fe07569e: Status 404 returned error can't find the container with id 0b9fb8fc4435e00367ffaf20dd088c3dfc778c541bbb7df21a091b89fe07569e Jul 03 17:35:31.208664 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:31.208613 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:31.208841 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:31.208693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:31.208841 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:31.208799 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:31.208957 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:31.208864 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:35.208849893 +0000 UTC m=+79.529105820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : configmap "kube-rbac-proxy" not found Jul 03 17:35:31.208957 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:31.208801 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:31.208957 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:31.208952 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:35.208939212 +0000 UTC m=+79.529195139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:31.279310 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:31.279277 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qcb5q_5213ab89-a837-4e59-8088-6496cb842bcb/serve-healthcheck-canary/0.log" Jul 03 17:35:31.636136 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:31.636108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" event={"ID":"73dbf323-e337-4460-867a-b7044141a7a4","Type":"ContainerStarted","Data":"0b9fb8fc4435e00367ffaf20dd088c3dfc778c541bbb7df21a091b89fe07569e"} Jul 03 17:35:32.409935 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.409902 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bhht2"] Jul 03 17:35:32.413007 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.412990 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.418583 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.418552 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 03 17:35:32.418716 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.418621 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 03 17:35:32.418716 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.418667 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 03 17:35:32.419474 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.419456 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 03 17:35:32.419583 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.419475 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bh6ss\"" Jul 03 17:35:32.427552 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.427524 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bhht2"] Jul 03 17:35:32.519323 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.519288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sxxr\" (UniqueName: \"kubernetes.io/projected/2776e908-bd82-4485-973d-9c8698d1640d-kube-api-access-8sxxr\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.519491 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.519333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2776e908-bd82-4485-973d-9c8698d1640d-signing-key\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.519491 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.519368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2776e908-bd82-4485-973d-9c8698d1640d-signing-cabundle\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.620806 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.620771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sxxr\" (UniqueName: \"kubernetes.io/projected/2776e908-bd82-4485-973d-9c8698d1640d-kube-api-access-8sxxr\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.620990 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.620817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2776e908-bd82-4485-973d-9c8698d1640d-signing-key\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.620990 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.620853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2776e908-bd82-4485-973d-9c8698d1640d-signing-cabundle\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.621592 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.621573 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2776e908-bd82-4485-973d-9c8698d1640d-signing-cabundle\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.623396 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.623375 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2776e908-bd82-4485-973d-9c8698d1640d-signing-key\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.636478 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.636443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sxxr\" (UniqueName: \"kubernetes.io/projected/2776e908-bd82-4485-973d-9c8698d1640d-kube-api-access-8sxxr\") pod \"service-ca-758f599c5-bhht2\" (UID: \"2776e908-bd82-4485-973d-9c8698d1640d\") " pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.642214 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.642187 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" event={"ID":"73dbf323-e337-4460-867a-b7044141a7a4","Type":"ContainerStarted","Data":"484807b382f3d5fdf412304564e3ab4a2a8d5885f64bea72f5b97040e1cab400"} Jul 03 17:35:32.642372 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.642235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" event={"ID":"73dbf323-e337-4460-867a-b7044141a7a4","Type":"ContainerStarted","Data":"43a963d6bbb2a20f595727d55a32f833e2fb64f322fdc603901ffe778261ac99"} Jul 03 17:35:32.674541 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.674443 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9thc5" podStartSLOduration=1.79639442 podStartE2EDuration="2.674428988s" totalImagesPullingTime="878.034568ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:32.672584809 +0000 UTC m=+76.992840759" watchObservedRunningTime="2026-07-03 17:35:32.674428988 +0000 UTC m=+76.994684937" Jul 03 17:35:32.722033 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.721998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-bhht2" Jul 03 17:35:32.859579 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:32.859549 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bhht2"] Jul 03 17:35:32.862776 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:32.862745 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2776e908_bd82_4485_973d_9c8698d1640d.slice/crio-91cac8217200c622a90de747c14e939643ea793b4b138e0ac382ce799035651d WatchSource:0}: Error finding container 91cac8217200c622a90de747c14e939643ea793b4b138e0ac382ce799035651d: Status 404 returned error can't find the container with id 91cac8217200c622a90de747c14e939643ea793b4b138e0ac382ce799035651d Jul 03 17:35:33.647006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:33.646963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-bhht2" event={"ID":"2776e908-bd82-4485-973d-9c8698d1640d","Type":"ContainerStarted","Data":"90785a189fe3db63297590905e902114ab16decb874b2379fc6d68851c91a04e"} Jul 03 17:35:33.647408 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:33.647024 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-bhht2" event={"ID":"2776e908-bd82-4485-973d-9c8698d1640d","Type":"ContainerStarted","Data":"91cac8217200c622a90de747c14e939643ea793b4b138e0ac382ce799035651d"} Jul 03 17:35:33.667211 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:33.667155 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-bhht2" podStartSLOduration=1.667138942 podStartE2EDuration="1.667138942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:33.666483568 +0000 UTC m=+77.986739529" watchObservedRunningTime="2026-07-03 17:35:33.667138942 +0000 UTC m=+77.987394892" Jul 03 17:35:35.255439 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:35.255400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:35.255818 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:35.255455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:35.255818 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:35.255521 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:35.255818 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:35.255555 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:35.255818 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:35.255574 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:43.255560833 +0000 UTC m=+87.575816761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : configmap "kube-rbac-proxy" not found Jul 03 17:35:35.255818 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:35.255619 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:43.255605102 +0000 UTC m=+87.575861035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:38.380269 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:38.380122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:38.380269 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:38.380160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:38.380770 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:38.380289 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:38.380770 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:38.380338 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:54.380314129 +0000 UTC m=+98.700570074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:38.380770 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:38.380369 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs podName:9d0fcbd2-5b1c-4d13-a03e-6886513b192e nodeName:}" failed. No retries permitted until 2026-07-03 17:35:54.380357296 +0000 UTC m=+98.700613230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs") pod "router-default-864f59f9d9-266vv" (UID: "9d0fcbd2-5b1c-4d13-a03e-6886513b192e") : secret "router-metrics-certs-default" not found Jul 03 17:35:38.683478 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:38.683442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:38.686025 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:38.685991 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9050e371-68a9-427b-9509-248eb93ea86d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-g8hw7\" (UID: \"9050e371-68a9-427b-9509-248eb93ea86d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:38.972309 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:38.972196 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" Jul 03 17:35:39.114222 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:39.114189 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7"] Jul 03 17:35:39.667956 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:39.667920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" event={"ID":"9050e371-68a9-427b-9509-248eb93ea86d","Type":"ContainerStarted","Data":"415cdd60a2940731dcb53c63d3b9bc123df817e132edf139f0de4fff6dfb79aa"} Jul 03 17:35:41.675576 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:41.675540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" event={"ID":"9050e371-68a9-427b-9509-248eb93ea86d","Type":"ContainerStarted","Data":"8c2b170b258436797105695a41cf710685396ed5da74a373924099be92cb96dd"} Jul 03 17:35:41.675946 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:41.675594 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" event={"ID":"9050e371-68a9-427b-9509-248eb93ea86d","Type":"ContainerStarted","Data":"75c5c8013706708cb0f8d20be8093180a32704449b63953de622137c3fd327c1"} Jul 03 17:35:43.326673 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:43.326630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:43.327019 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:43.326697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:43.327019 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:43.326779 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:43.327019 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:35:43.326872 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls podName:fd67405f-d619-4fb8-b8cd-d82c417071a5 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:59.326857239 +0000 UTC m=+103.647113167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ndjsz" (UID: "fd67405f-d619-4fb8-b8cd-d82c417071a5") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:43.327293 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:43.327274 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd67405f-d619-4fb8-b8cd-d82c417071a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:54.417115 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.417067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:54.417115 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.417119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:54.417713 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.417694 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-service-ca-bundle\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:54.419526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.419508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d0fcbd2-5b1c-4d13-a03e-6886513b192e-metrics-certs\") pod \"router-default-864f59f9d9-266vv\" (UID: \"9d0fcbd2-5b1c-4d13-a03e-6886513b192e\") " pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:54.552098 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.552047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:54.687187 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.687093 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-g8hw7" podStartSLOduration=31.007232783 podStartE2EDuration="32.687073342s" totalImagesPullingTime="1.679840559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:41.694966368 +0000 UTC m=+86.015222320" watchObservedRunningTime="2026-07-03 17:35:54.687073342 +0000 UTC m=+99.007329292" Jul 03 17:35:54.687471 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.687454 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-864f59f9d9-266vv"] Jul 03 17:35:54.690199 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:54.690172 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0fcbd2_5b1c_4d13_a03e_6886513b192e.slice/crio-6b190c8a193973cd6e886d732a134c4e8336e00fb0980d36e81f73e0fc94e1e1 WatchSource:0}: Error finding container 6b190c8a193973cd6e886d732a134c4e8336e00fb0980d36e81f73e0fc94e1e1: Status 404 returned error can't find the container with id 6b190c8a193973cd6e886d732a134c4e8336e00fb0980d36e81f73e0fc94e1e1 Jul 03 17:35:54.719834 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:54.719477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-864f59f9d9-266vv" event={"ID":"9d0fcbd2-5b1c-4d13-a03e-6886513b192e","Type":"ContainerStarted","Data":"6b190c8a193973cd6e886d732a134c4e8336e00fb0980d36e81f73e0fc94e1e1"} Jul 03 17:35:55.724377 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:55.724341 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-864f59f9d9-266vv" event={"ID":"9d0fcbd2-5b1c-4d13-a03e-6886513b192e","Type":"ContainerStarted","Data":"5158bb5b054cedbfe410b0d8bf5c345147f11d6cc9faf9308a90777863b93cd1"} Jul 03 17:35:55.747846 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:55.747796 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-864f59f9d9-266vv" podStartSLOduration=33.747777552 podStartE2EDuration="33.747777552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:55.747643685 +0000 UTC m=+100.067899635" watchObservedRunningTime="2026-07-03 17:35:55.747777552 +0000 UTC m=+100.068033503" Jul 03 17:35:56.029479 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.029401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:35:56.031789 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.031759 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e-metrics-tls\") pod \"dns-default-qlw9b\" (UID: \"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e\") " pod="openshift-dns/dns-default-qlw9b" Jul 03 17:35:56.295156 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.295080 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kcqds\"" Jul 03 17:35:56.303254 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.303233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qlw9b" Jul 03 17:35:56.429585 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.429557 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qlw9b"] Jul 03 17:35:56.432565 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:56.432544 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3a6b47_9a3c_4f14_8a90_2836fa3c3b3e.slice/crio-d711d072b095fc506c43fc668dcce1e72bd27ddf85c344318ea5d1d2e8aea9dd WatchSource:0}: Error finding container d711d072b095fc506c43fc668dcce1e72bd27ddf85c344318ea5d1d2e8aea9dd: Status 404 returned error can't find the container with id d711d072b095fc506c43fc668dcce1e72bd27ddf85c344318ea5d1d2e8aea9dd Jul 03 17:35:56.553136 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.553044 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:56.555754 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.555728 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:56.728669 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.728626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qlw9b" event={"ID":"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e","Type":"ContainerStarted","Data":"d711d072b095fc506c43fc668dcce1e72bd27ddf85c344318ea5d1d2e8aea9dd"} Jul 03 17:35:56.729035 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.728843 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:56.730112 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:56.730093 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-864f59f9d9-266vv" Jul 03 17:35:58.738324 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:58.738291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qlw9b" event={"ID":"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e","Type":"ContainerStarted","Data":"ec0b2bb5cf767c9acd520e7ce1842fcdb0fabeca05dab2843a9947bd043e2d91"} Jul 03 17:35:58.738701 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:58.738346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qlw9b" event={"ID":"bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e","Type":"ContainerStarted","Data":"10515b1ba7b22907edc96062366fe9bc06ae97fd63280c8ab1ff2fed88df9421"} Jul 03 17:35:58.758047 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:58.757990 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qlw9b" podStartSLOduration=65.260105603 podStartE2EDuration="1m6.757973398s" totalImagesPullingTime="1.497867795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:58.757061978 +0000 UTC m=+103.077317928" watchObservedRunningTime="2026-07-03 17:35:58.757973398 +0000 UTC m=+103.078229348" Jul 03 17:35:59.355069 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:59.355031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:59.357427 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:59.357407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd67405f-d619-4fb8-b8cd-d82c417071a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ndjsz\" (UID: \"fd67405f-d619-4fb8-b8cd-d82c417071a5\") " pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:59.631302 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:59.631195 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wfslb" Jul 03 17:35:59.637710 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:59.637693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ndjsz" Jul 03 17:35:59.742593 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:59.742563 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qlw9b" Jul 03 17:35:59.798408 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:35:59.798379 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ndjsz"] Jul 03 17:35:59.801129 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:35:59.801103 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd67405f_d619_4fb8_b8cd_d82c417071a5.slice/crio-d3aff55f8eb07a7fe284be419f0626140177b1cbcb5a07757be55741410d6f32 WatchSource:0}: Error finding container d3aff55f8eb07a7fe284be419f0626140177b1cbcb5a07757be55741410d6f32: Status 404 returned error can't find the container with id d3aff55f8eb07a7fe284be419f0626140177b1cbcb5a07757be55741410d6f32 Jul 03 17:36:00.748541 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:00.748503 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ndjsz" event={"ID":"fd67405f-d619-4fb8-b8cd-d82c417071a5","Type":"ContainerStarted","Data":"d3aff55f8eb07a7fe284be419f0626140177b1cbcb5a07757be55741410d6f32"} Jul 03 17:36:04.768497 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:04.768462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ndjsz" event={"ID":"fd67405f-d619-4fb8-b8cd-d82c417071a5","Type":"ContainerStarted","Data":"65a60d94a4da81a0bac488319e85284ea42580f0e00c1883c3ac83d1d526ad6e"} Jul 03 17:36:05.774737 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:05.774698 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ndjsz" event={"ID":"fd67405f-d619-4fb8-b8cd-d82c417071a5","Type":"ContainerStarted","Data":"6fe2b11b54a5e8232a696c6c33fbba7d37f1027cad650625a8c86f0678fb8384"} Jul 03 17:36:07.359158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.359118 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz"] Jul 03 17:36:07.369613 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.369575 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.375020 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.374318 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 17:36:07.375020 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.374340 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 03 17:36:07.375020 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.374672 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 17:36:07.375020 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.374699 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lt8b8\"" Jul 03 17:36:07.375020 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.374823 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 03 17:36:07.375020 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.374893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 17:36:07.382870 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.382800 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz"] Jul 03 17:36:07.401048 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.401022 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ddrht"] Jul 03 17:36:07.404031 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.404007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.405104 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.405076 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86"] Jul 03 17:36:07.407526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.407224 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 17:36:07.407526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.407312 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 17:36:07.407526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.407505 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 17:36:07.408142 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.407611 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z24xg\"" Jul 03 17:36:07.410349 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.410325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.412402 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.412385 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7t288\"" Jul 03 17:36:07.412631 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.412616 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 03 17:36:07.412847 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.412833 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 03 17:36:07.413894 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.413879 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 03 17:36:07.432227 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.432154 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86"] Jul 03 17:36:07.523155 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-tls\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523291 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.523291 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523291 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d600d-0a1a-4076-8c69-ee593b4a13a9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.523291 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-root\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523443 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f272b\" (UniqueName: \"kubernetes.io/projected/7752b309-c0db-4a05-b21f-ef83753246a8-kube-api-access-f272b\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523443 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-textfile\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523443 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523443 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghqbn\" (UniqueName: \"kubernetes.io/projected/e37bf274-09da-483d-a9af-1269e809fe1a-kube-api-access-ghqbn\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.523596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7752b309-c0db-4a05-b21f-ef83753246a8-metrics-client-ca\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.523596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.523596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-wtmp\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523785 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37bf274-09da-483d-a9af-1269e809fe1a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.523785 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523626 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/740d600d-0a1a-4076-8c69-ee593b4a13a9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.523785 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-sys\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.523785 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/740d600d-0a1a-4076-8c69-ee593b4a13a9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.523785 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfbz\" (UniqueName: \"kubernetes.io/projected/740d600d-0a1a-4076-8c69-ee593b4a13a9-kube-api-access-6kfbz\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.523785 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.523773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e37bf274-09da-483d-a9af-1269e809fe1a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.624867 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.624793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-wtmp\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.624867 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.624827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37bf274-09da-483d-a9af-1269e809fe1a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.624867 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.624843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/740d600d-0a1a-4076-8c69-ee593b4a13a9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.625081 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.624977 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-wtmp\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625081 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-sys\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625081 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/740d600d-0a1a-4076-8c69-ee593b4a13a9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.625195 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfbz\" (UniqueName: \"kubernetes.io/projected/740d600d-0a1a-4076-8c69-ee593b4a13a9-kube-api-access-6kfbz\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.625195 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e37bf274-09da-483d-a9af-1269e809fe1a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.625195 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625123 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-sys\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625195 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-tls\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625415 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.625415 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625415 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d600d-0a1a-4076-8c69-ee593b4a13a9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.625415 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-root\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625415 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f272b\" (UniqueName: \"kubernetes.io/projected/7752b309-c0db-4a05-b21f-ef83753246a8-kube-api-access-f272b\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625415 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-textfile\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625415 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625394 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghqbn\" (UniqueName: \"kubernetes.io/projected/e37bf274-09da-483d-a9af-1269e809fe1a-kube-api-access-ghqbn\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.625808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7752b309-c0db-4a05-b21f-ef83753246a8-metrics-client-ca\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.625808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.625808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.625808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625642 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/740d600d-0a1a-4076-8c69-ee593b4a13a9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.625808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625653 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e37bf274-09da-483d-a9af-1269e809fe1a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.625808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625727 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7752b309-c0db-4a05-b21f-ef83753246a8-root\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.626339 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.625901 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.626339 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.626077 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e37bf274-09da-483d-a9af-1269e809fe1a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.626339 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.626116 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-textfile\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.626539 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.626487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7752b309-c0db-4a05-b21f-ef83753246a8-metrics-client-ca\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.626705 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.626596 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.628124 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.628100 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-tls\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.628283 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.628241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/740d600d-0a1a-4076-8c69-ee593b4a13a9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.628622 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.628597 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7752b309-c0db-4a05-b21f-ef83753246a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.628703 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.628633 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/740d600d-0a1a-4076-8c69-ee593b4a13a9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.628909 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.628888 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.629276 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.629229 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e37bf274-09da-483d-a9af-1269e809fe1a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.643207 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.643185 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfbz\" (UniqueName: \"kubernetes.io/projected/740d600d-0a1a-4076-8c69-ee593b4a13a9-kube-api-access-6kfbz\") pod \"openshift-state-metrics-54cf96dfcf-9j9sz\" (UID: \"740d600d-0a1a-4076-8c69-ee593b4a13a9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.643562 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.643545 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f272b\" (UniqueName: \"kubernetes.io/projected/7752b309-c0db-4a05-b21f-ef83753246a8-kube-api-access-f272b\") pod \"node-exporter-ddrht\" (UID: \"7752b309-c0db-4a05-b21f-ef83753246a8\") " pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.645219 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.645199 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghqbn\" (UniqueName: \"kubernetes.io/projected/e37bf274-09da-483d-a9af-1269e809fe1a-kube-api-access-ghqbn\") pod \"kube-state-metrics-7c9dbb8b7d-9mq86\" (UID: \"e37bf274-09da-483d-a9af-1269e809fe1a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.683698 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.683665 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" Jul 03 17:36:07.718644 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.718618 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ddrht" Jul 03 17:36:07.725740 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.725710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" Jul 03 17:36:07.728657 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:36:07.728635 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7752b309_c0db_4a05_b21f_ef83753246a8.slice/crio-69f1eece444cf27209ae56d46793c9b60a8b559fe49c5ca5cc1d4ead8cc57a64 WatchSource:0}: Error finding container 69f1eece444cf27209ae56d46793c9b60a8b559fe49c5ca5cc1d4ead8cc57a64: Status 404 returned error can't find the container with id 69f1eece444cf27209ae56d46793c9b60a8b559fe49c5ca5cc1d4ead8cc57a64 Jul 03 17:36:07.783423 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.783387 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddrht" event={"ID":"7752b309-c0db-4a05-b21f-ef83753246a8","Type":"ContainerStarted","Data":"69f1eece444cf27209ae56d46793c9b60a8b559fe49c5ca5cc1d4ead8cc57a64"} Jul 03 17:36:07.787111 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.786237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ndjsz" event={"ID":"fd67405f-d619-4fb8-b8cd-d82c417071a5","Type":"ContainerStarted","Data":"a86ffbdf1fab48dabe45052e9633c633d0ac499a5153b94a9f74d46d418f3bd9"} Jul 03 17:36:07.837270 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.837203 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ndjsz" podStartSLOduration=33.274383529 podStartE2EDuration="40.837185936s" totalImagesPullingTime="7.562802407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:35:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:07.834922075 +0000 UTC m=+112.155178021" watchObservedRunningTime="2026-07-03 17:36:07.837185936 +0000 UTC m=+112.157441886" Jul 03 17:36:07.840417 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:36:07.840389 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740d600d_0a1a_4076_8c69_ee593b4a13a9.slice/crio-b9cdfcac9df44d07961f472331e5c3a848ade96ec834f55548ac3aa792b0572b WatchSource:0}: Error finding container b9cdfcac9df44d07961f472331e5c3a848ade96ec834f55548ac3aa792b0572b: Status 404 returned error can't find the container with id b9cdfcac9df44d07961f472331e5c3a848ade96ec834f55548ac3aa792b0572b Jul 03 17:36:07.843762 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.843541 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz"] Jul 03 17:36:07.920687 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:07.920654 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86"] Jul 03 17:36:07.923782 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:36:07.923755 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37bf274_09da_483d_a9af_1269e809fe1a.slice/crio-cab17e355f9450d9fefe0043abb2528ac584b7ea8fc745c0df50b625a40dad1c WatchSource:0}: Error finding container cab17e355f9450d9fefe0043abb2528ac584b7ea8fc745c0df50b625a40dad1c: Status 404 returned error can't find the container with id cab17e355f9450d9fefe0043abb2528ac584b7ea8fc745c0df50b625a40dad1c Jul 03 17:36:08.792177 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.792118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" event={"ID":"e37bf274-09da-483d-a9af-1269e809fe1a","Type":"ContainerStarted","Data":"cab17e355f9450d9fefe0043abb2528ac584b7ea8fc745c0df50b625a40dad1c"} Jul 03 17:36:08.795051 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.795023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" event={"ID":"740d600d-0a1a-4076-8c69-ee593b4a13a9","Type":"ContainerStarted","Data":"b7f4e89bf9c7bb184962918efbe43c405a10c75b55dba63193e868fa381c87cf"} Jul 03 17:36:08.795171 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.795068 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" event={"ID":"740d600d-0a1a-4076-8c69-ee593b4a13a9","Type":"ContainerStarted","Data":"af3ca361c937eb9386cc3c1140460e59f76114b822915294b40e57009e87b0d6"} Jul 03 17:36:08.795171 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.795094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" event={"ID":"740d600d-0a1a-4076-8c69-ee593b4a13a9","Type":"ContainerStarted","Data":"b9cdfcac9df44d07961f472331e5c3a848ade96ec834f55548ac3aa792b0572b"} Jul 03 17:36:08.900472 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.900441 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:36:08.903790 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.903766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.926135 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926110 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 17:36:08.926288 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926158 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 17:36:08.926288 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926167 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 17:36:08.926288 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926169 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 17:36:08.926469 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926301 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 17:36:08.926469 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926416 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 17:36:08.926566 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926501 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 17:36:08.926566 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.926535 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 17:36:08.927753 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.927735 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nrft5\"" Jul 03 17:36:08.932873 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.932853 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 17:36:08.941540 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941634 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941634 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941710 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941631 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941775 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941775 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941775 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttdr4\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-kube-api-access-ttdr4\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941868 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-out\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941868 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941959 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941959 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.941959 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.942081 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:08.941993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-web-config\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043441 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043441 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043441 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttdr4\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-kube-api-access-ttdr4\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043441 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-out\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043620 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043620 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043620 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043620 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-web-config\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.043844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.044002 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.043917 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.044538 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.044507 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.045089 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.045064 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.046231 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.046196 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-out\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.046515 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.046494 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.047821 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.047783 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.048016 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.047992 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-web-config\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.048162 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.048138 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.048369 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.048345 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.048448 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.048354 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.049215 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.049193 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.049522 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.049498 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.070549 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.070516 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttdr4\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-kube-api-access-ttdr4\") pod \"alertmanager-main-0\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.083431 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.083400 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:36:09.214382 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.214350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:09.628879 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:36:09.628847 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1e80d4_ae0b_4bdd_ad9c_d72202d06754.slice/crio-38c7baa228c067e21a6cd967f47e3c313947072b38939935768e06035206f835 WatchSource:0}: Error finding container 38c7baa228c067e21a6cd967f47e3c313947072b38939935768e06035206f835: Status 404 returned error can't find the container with id 38c7baa228c067e21a6cd967f47e3c313947072b38939935768e06035206f835 Jul 03 17:36:09.630031 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.629995 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:36:09.750630 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.750602 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qlw9b" Jul 03 17:36:09.800289 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.800236 2580 generic.go:356] "Generic (PLEG): container finished" podID="7752b309-c0db-4a05-b21f-ef83753246a8" containerID="e53c8d2469a24988dd92c5dd0535e4406b87f4c030acfd380bdd7eaa256d5ed5" exitCode=0 Jul 03 17:36:09.800694 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.800327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddrht" event={"ID":"7752b309-c0db-4a05-b21f-ef83753246a8","Type":"ContainerDied","Data":"e53c8d2469a24988dd92c5dd0535e4406b87f4c030acfd380bdd7eaa256d5ed5"} Jul 03 17:36:09.801573 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.801553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerStarted","Data":"38c7baa228c067e21a6cd967f47e3c313947072b38939935768e06035206f835"} Jul 03 17:36:09.803713 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.803686 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" event={"ID":"740d600d-0a1a-4076-8c69-ee593b4a13a9","Type":"ContainerStarted","Data":"cdd1f51c27458041b693c27740f384c69b4965932726f3b5990e33b11f927ce6"} Jul 03 17:36:09.805743 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.805721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" event={"ID":"e37bf274-09da-483d-a9af-1269e809fe1a","Type":"ContainerStarted","Data":"41b71c6be68fa7ee390f32f8e621da6e71a39068fdf50fd10c2e8964a3dd618f"} Jul 03 17:36:09.805826 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.805763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" event={"ID":"e37bf274-09da-483d-a9af-1269e809fe1a","Type":"ContainerStarted","Data":"8515c9dae43ed952e91dc2df9f9ccbcae34b31567a9664291eb021ea65074fb0"} Jul 03 17:36:09.805826 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.805786 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" event={"ID":"e37bf274-09da-483d-a9af-1269e809fe1a","Type":"ContainerStarted","Data":"529fe920d27fc764ed982f33766be97c63427e564e91c256a2acbf70a1d23027"} Jul 03 17:36:09.940289 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.940214 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9mq86" podStartSLOduration=1.641120133 podStartE2EDuration="2.940197906s" totalImagesPullingTime="1.299077773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:09.885292249 +0000 UTC m=+114.205548201" watchObservedRunningTime="2026-07-03 17:36:09.940197906 +0000 UTC m=+114.260453855" Jul 03 17:36:09.940559 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:09.940536 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9j9sz" podStartSLOduration=1.67428408 podStartE2EDuration="2.940529411s" totalImagesPullingTime="1.266245331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:09.938990028 +0000 UTC m=+114.259245980" watchObservedRunningTime="2026-07-03 17:36:09.940529411 +0000 UTC m=+114.260785360" Jul 03 17:36:10.811699 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:10.811660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddrht" event={"ID":"7752b309-c0db-4a05-b21f-ef83753246a8","Type":"ContainerStarted","Data":"e0036ece9a788a48c5393e3c993c109698252906ca14cb3f4aa2daea5cd14691"} Jul 03 17:36:10.812142 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:10.811723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddrht" event={"ID":"7752b309-c0db-4a05-b21f-ef83753246a8","Type":"ContainerStarted","Data":"f7ec1e67ae1abf0d230d929738693df582587e0122a7b96c85245511659d45f7"} Jul 03 17:36:10.813178 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:10.813151 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerID="c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474" exitCode=0 Jul 03 17:36:10.813282 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:10.813241 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474"} Jul 03 17:36:10.848501 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:10.848423 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ddrht" podStartSLOduration=2.274082261 podStartE2EDuration="3.848408825s" totalImagesPullingTime="1.488606997s" totalInitContainerRuntime="85.719567ms" isStatefulPod=true podCreationTimestamp="2026-07-03 17:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:10.847433879 +0000 UTC m=+115.167689828" watchObservedRunningTime="2026-07-03 17:36:10.848408825 +0000 UTC m=+115.168664775" Jul 03 17:36:12.824236 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:12.824204 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerStarted","Data":"a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246"} Jul 03 17:36:12.824590 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:12.824302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerStarted","Data":"1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb"} Jul 03 17:36:12.824590 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:12.824332 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerStarted","Data":"bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2"} Jul 03 17:36:12.824590 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:12.824355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerStarted","Data":"c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27"} Jul 03 17:36:12.824590 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:12.824380 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerStarted","Data":"de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd"} Jul 03 17:36:13.832050 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:13.832020 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerStarted","Data":"227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3"} Jul 03 17:36:13.877384 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:13.877293 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.41960599 podStartE2EDuration="5.877275583s" totalImagesPullingTime="3.441895466s" totalInitContainerRuntime="15.774127ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:13.875309005 +0000 UTC m=+118.195564958" watchObservedRunningTime="2026-07-03 17:36:13.877275583 +0000 UTC m=+118.197531544" Jul 03 17:36:14.726594 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.726078 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:36:14.734402 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.734380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.745527 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.745498 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 03 17:36:14.745527 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.745499 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 03 17:36:14.745704 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.745532 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 03 17:36:14.745704 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.745542 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 03 17:36:14.745704 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.745563 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 03 17:36:14.745704 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.745592 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 03 17:36:14.747110 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.747094 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 03 17:36:14.747422 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.747409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 03 17:36:14.747495 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.747424 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 03 17:36:14.747495 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.747410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 03 17:36:14.748377 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.748362 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 03 17:36:14.748975 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.748960 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 03 17:36:14.749049 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.748989 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 03 17:36:14.773093 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.773060 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4j60hip1ee9it\"" Jul 03 17:36:14.773093 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.773061 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8xxd6\"" Jul 03 17:36:14.773511 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.773493 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 03 17:36:14.774802 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.774781 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 03 17:36:14.787535 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787535 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787677 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787677 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787677 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787759 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787759 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787759 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787860 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787860 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787860 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.787860 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmmmq\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-kube-api-access-hmmmq\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787923 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787959 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.787985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.788006 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.788007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.808580 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.808548 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:36:14.889328 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889328 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889810 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889810 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889810 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889810 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889810 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889810 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.889810 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889803 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.889994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890100 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890158 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890671 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.890671 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.890285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmmq\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-kube-api-access-hmmmq\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.891094 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.891071 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.891930 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.891902 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.892452 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.892427 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.892938 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.892897 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.893205 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.893178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.893305 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.893186 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.893474 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.893451 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.893649 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.893622 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.893808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.893708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.894275 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.894158 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.894414 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.894269 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.894594 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.894571 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.895159 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.895134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config-out\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.895715 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.895690 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.895715 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.895707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.896280 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.896239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.896643 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.896616 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-web-config\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.896643 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.896636 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:14.906547 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:14.906529 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmmq\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-kube-api-access-hmmmq\") pod \"prometheus-k8s-0\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:15.043675 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:15.043591 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:15.256774 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:15.256738 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:36:15.265773 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:36:15.265728 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2197aea_3dbe_4128_ad8e_a0ce0a644b09.slice/crio-7f1ea24efb2d94b7cd54def67dcc50093b9c9a1f7d916a117e254d04a15f5acf WatchSource:0}: Error finding container 7f1ea24efb2d94b7cd54def67dcc50093b9c9a1f7d916a117e254d04a15f5acf: Status 404 returned error can't find the container with id 7f1ea24efb2d94b7cd54def67dcc50093b9c9a1f7d916a117e254d04a15f5acf Jul 03 17:36:15.841957 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:15.841916 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" exitCode=0 Jul 03 17:36:15.842145 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:15.841997 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82"} Jul 03 17:36:15.842145 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:15.842080 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerStarted","Data":"7f1ea24efb2d94b7cd54def67dcc50093b9c9a1f7d916a117e254d04a15f5acf"} Jul 03 17:36:18.857852 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:18.857815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerStarted","Data":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} Jul 03 17:36:18.858279 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:18.857904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerStarted","Data":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} Jul 03 17:36:20.868724 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:20.868638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerStarted","Data":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} Jul 03 17:36:20.869087 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:20.868730 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerStarted","Data":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} Jul 03 17:36:20.869087 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:20.868763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerStarted","Data":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} Jul 03 17:36:20.869087 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:20.868788 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerStarted","Data":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} Jul 03 17:36:20.926845 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:20.926797 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.523413105 podStartE2EDuration="6.926782599s" totalImagesPullingTime="4.384975274s" totalInitContainerRuntime="18.39422ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:20.926498761 +0000 UTC m=+125.246754710" watchObservedRunningTime="2026-07-03 17:36:20.926782599 +0000 UTC m=+125.247038549" Jul 03 17:36:25.044560 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:25.044520 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:25.993844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:25.993808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:36:25.996200 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:25.996177 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/499876cc-475d-4596-abbe-41169a803961-metrics-certs\") pod \"network-metrics-daemon-4zbsx\" (UID: \"499876cc-475d-4596-abbe-41169a803961\") " pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:36:26.131187 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:26.131161 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m2zdg\"" Jul 03 17:36:26.137772 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:26.137747 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zbsx" Jul 03 17:36:26.306296 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:26.306206 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4zbsx"] Jul 03 17:36:26.309596 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:36:26.309569 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499876cc_475d_4596_abbe_41169a803961.slice/crio-9a18473b7307e3efebeb27ef92c24d572a2828237d887e93aa6f421f59794106 WatchSource:0}: Error finding container 9a18473b7307e3efebeb27ef92c24d572a2828237d887e93aa6f421f59794106: Status 404 returned error can't find the container with id 9a18473b7307e3efebeb27ef92c24d572a2828237d887e93aa6f421f59794106 Jul 03 17:36:26.893748 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:26.893704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zbsx" event={"ID":"499876cc-475d-4596-abbe-41169a803961","Type":"ContainerStarted","Data":"9a18473b7307e3efebeb27ef92c24d572a2828237d887e93aa6f421f59794106"} Jul 03 17:36:27.900031 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:27.899984 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zbsx" event={"ID":"499876cc-475d-4596-abbe-41169a803961","Type":"ContainerStarted","Data":"fcebb56ed8d534f453b426bbe5ec8f58973ad78ab71d2679d1c0975b84345b14"} Jul 03 17:36:27.900537 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:27.900045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zbsx" event={"ID":"499876cc-475d-4596-abbe-41169a803961","Type":"ContainerStarted","Data":"7781e1149b457fabe29dac1f81269864303a609e1922eef487cc3c9318b353f3"} Jul 03 17:36:27.921927 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:27.921867 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4zbsx" podStartSLOduration=129.998713606 podStartE2EDuration="2m10.921851355s" totalImagesPullingTime="923.137749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:27.920283854 +0000 UTC m=+132.240539802" watchObservedRunningTime="2026-07-03 17:36:27.921851355 +0000 UTC m=+132.242107305" Jul 03 17:36:34.930946 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:34.930914 2580 generic.go:356] "Generic (PLEG): container finished" podID="914a1642-a8b6-438e-a099-db30e0692413" containerID="28669a9530353848445e03f10c1d4ad0f56bc5d36423ae025c508a9d206aad00" exitCode=0 Jul 03 17:36:34.931330 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:34.930989 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" event={"ID":"914a1642-a8b6-438e-a099-db30e0692413","Type":"ContainerDied","Data":"28669a9530353848445e03f10c1d4ad0f56bc5d36423ae025c508a9d206aad00"} Jul 03 17:36:34.931393 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:34.931380 2580 scope.go:117] "RemoveContainer" containerID="28669a9530353848445e03f10c1d4ad0f56bc5d36423ae025c508a9d206aad00" Jul 03 17:36:35.936314 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:35.936271 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bgmxl" event={"ID":"914a1642-a8b6-438e-a099-db30e0692413","Type":"ContainerStarted","Data":"5d5e6d3e55d964cf7ddee09fabfa12a30010aa5c61ad56a79a34d5e07749862e"} Jul 03 17:36:44.972455 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:44.972420 2580 generic.go:356] "Generic (PLEG): container finished" podID="465b40bf-15d5-4b5c-87ae-cf9791f66c6e" containerID="8540f986aabbaa607765019bc28eaa28afc1ee4de42334a33e9dfc5a98693d13" exitCode=0 Jul 03 17:36:44.972865 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:44.972491 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" event={"ID":"465b40bf-15d5-4b5c-87ae-cf9791f66c6e","Type":"ContainerDied","Data":"8540f986aabbaa607765019bc28eaa28afc1ee4de42334a33e9dfc5a98693d13"} Jul 03 17:36:44.972865 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:44.972813 2580 scope.go:117] "RemoveContainer" containerID="8540f986aabbaa607765019bc28eaa28afc1ee4de42334a33e9dfc5a98693d13" Jul 03 17:36:45.978205 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:36:45.978175 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dtfdl" event={"ID":"465b40bf-15d5-4b5c-87ae-cf9791f66c6e","Type":"ContainerStarted","Data":"ab6f990f10f1a5df89bcb3c308ca5ca76224a5ee1283984358a5281875edbb65"} Jul 03 17:37:15.044776 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:15.044700 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:15.060878 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:15.060854 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:15.101759 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:15.101732 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:28.487606 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:28.487570 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:28.487989 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:28.487862 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="alertmanager" containerID="cri-o://de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd" gracePeriod=120 Jul 03 17:37:28.487989 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:28.487919 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-metric" containerID="cri-o://a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246" gracePeriod=120 Jul 03 17:37:28.487989 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:28.487952 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="prom-label-proxy" containerID="cri-o://227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3" gracePeriod=120 Jul 03 17:37:28.488152 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:28.487974 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-web" containerID="cri-o://bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2" gracePeriod=120 Jul 03 17:37:28.488152 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:28.487997 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="config-reloader" containerID="cri-o://c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27" gracePeriod=120 Jul 03 17:37:28.488152 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:28.487998 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy" containerID="cri-o://1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb" gracePeriod=120 Jul 03 17:37:29.142526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142491 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerID="227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3" exitCode=0 Jul 03 17:37:29.142526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142514 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerID="1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb" exitCode=0 Jul 03 17:37:29.142526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142522 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerID="bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2" exitCode=0 Jul 03 17:37:29.142526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142528 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerID="c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27" exitCode=0 Jul 03 17:37:29.142526 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142533 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerID="de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd" exitCode=0 Jul 03 17:37:29.142809 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142563 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3"} Jul 03 17:37:29.142809 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb"} Jul 03 17:37:29.142809 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142654 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2"} Jul 03 17:37:29.142809 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27"} Jul 03 17:37:29.142809 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.142701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd"} Jul 03 17:37:29.830947 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.830923 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.932343 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932315 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-main-db\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932496 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932351 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-cluster-tls-config\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932496 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932390 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-trusted-ca-bundle\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932496 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932425 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-volume\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932496 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932445 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttdr4\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-kube-api-access-ttdr4\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932496 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932476 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-metrics-client-ca\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932733 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932504 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-main-tls\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932733 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932713 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-out\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932842 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932777 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932842 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932830 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-web\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932949 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932866 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-web-config\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.932949 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932897 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.933527 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.933103 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-tls-assets\") pod \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\" (UID: \"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754\") " Jul 03 17:37:29.933944 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932709 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:29.933944 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.932843 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:29.933944 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.933869 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:29.935622 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.935591 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-out" (OuterVolumeSpecName: "config-out") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:29.935808 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.935643 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:29.936173 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.936148 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-volume" (OuterVolumeSpecName: "config-volume") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:29.936287 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.936171 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:29.936444 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.936417 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:29.936579 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.936557 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-kube-api-access-ttdr4" (OuterVolumeSpecName: "kube-api-access-ttdr4") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "kube-api-access-ttdr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:29.936996 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.936976 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:29.937396 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.937376 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:29.941118 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.941091 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:29.947990 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:29.947967 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-web-config" (OuterVolumeSpecName: "web-config") pod "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" (UID: "4c1e80d4-ae0b-4bdd-ad9c-d72202d06754"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:30.034569 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034538 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034569 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034564 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-web-config\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034569 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034575 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034583 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-tls-assets\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034592 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-main-db\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034600 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-cluster-tls-config\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034610 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034618 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-volume\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034629 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttdr4\" (UniqueName: \"kubernetes.io/projected/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-kube-api-access-ttdr4\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034636 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-metrics-client-ca\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034644 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-main-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034652 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-config-out\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.034767 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.034660 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:30.150058 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.150025 2580 generic.go:356] "Generic (PLEG): container finished" podID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerID="a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246" exitCode=0 Jul 03 17:37:30.150214 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.150088 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246"} Jul 03 17:37:30.150214 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.150106 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.150214 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.150149 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c1e80d4-ae0b-4bdd-ad9c-d72202d06754","Type":"ContainerDied","Data":"38c7baa228c067e21a6cd967f47e3c313947072b38939935768e06035206f835"} Jul 03 17:37:30.150214 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.150181 2580 scope.go:117] "RemoveContainer" containerID="227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3" Jul 03 17:37:30.158877 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.158858 2580 scope.go:117] "RemoveContainer" containerID="a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246" Jul 03 17:37:30.170576 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.170269 2580 scope.go:117] "RemoveContainer" containerID="1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb" Jul 03 17:37:30.176064 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.176038 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:30.179008 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.178986 2580 scope.go:117] "RemoveContainer" containerID="bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2" Jul 03 17:37:30.180611 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.180592 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:30.185690 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.185671 2580 scope.go:117] "RemoveContainer" containerID="c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27" Jul 03 17:37:30.192549 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.192530 2580 scope.go:117] "RemoveContainer" containerID="de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd" Jul 03 17:37:30.199243 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.199229 2580 scope.go:117] "RemoveContainer" containerID="c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474" Jul 03 17:37:30.206516 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.206498 2580 scope.go:117] "RemoveContainer" containerID="227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3" Jul 03 17:37:30.206806 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:30.206781 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3\": container with ID starting with 227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3 not found: ID does not exist" containerID="227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3" Jul 03 17:37:30.206854 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.206814 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3"} err="failed to get container status \"227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3\": rpc error: code = NotFound desc = could not find container \"227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3\": container with ID starting with 227150517b3236930a31724467734c0e380699211ec5063468b0c7d58fa89cb3 not found: ID does not exist" Jul 03 17:37:30.206854 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.206848 2580 scope.go:117] "RemoveContainer" containerID="a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246" Jul 03 17:37:30.207066 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:30.207051 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246\": container with ID starting with a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246 not found: ID does not exist" containerID="a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246" Jul 03 17:37:30.207126 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207071 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246"} err="failed to get container status \"a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246\": rpc error: code = NotFound desc = could not find container \"a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246\": container with ID starting with a98a4c2f9a5e3dee1dbc81efb1a999eddfcd45da90438475fbd49a5a39bbe246 not found: ID does not exist" Jul 03 17:37:30.207126 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207084 2580 scope.go:117] "RemoveContainer" containerID="1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb" Jul 03 17:37:30.207352 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:30.207325 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb\": container with ID starting with 1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb not found: ID does not exist" containerID="1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb" Jul 03 17:37:30.207453 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207359 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb"} err="failed to get container status \"1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb\": rpc error: code = NotFound desc = could not find container \"1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb\": container with ID starting with 1d607de2b82e9ff460a894ffddc0c130d6cd82e8caaff4ba1c502297437633cb not found: ID does not exist" Jul 03 17:37:30.207453 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207379 2580 scope.go:117] "RemoveContainer" containerID="bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2" Jul 03 17:37:30.207646 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:30.207628 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2\": container with ID starting with bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2 not found: ID does not exist" containerID="bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2" Jul 03 17:37:30.207684 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207652 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2"} err="failed to get container status \"bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2\": rpc error: code = NotFound desc = could not find container \"bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2\": container with ID starting with bcf13a57ca81ac587201c7753e85652dcc720ae47db8d710d07916b772b794e2 not found: ID does not exist" Jul 03 17:37:30.207684 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207665 2580 scope.go:117] "RemoveContainer" containerID="c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27" Jul 03 17:37:30.207766 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207737 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" path="/var/lib/kubelet/pods/4c1e80d4-ae0b-4bdd-ad9c-d72202d06754/volumes" Jul 03 17:37:30.207926 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:30.207907 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27\": container with ID starting with c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27 not found: ID does not exist" containerID="c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27" Jul 03 17:37:30.207971 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207935 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27"} err="failed to get container status \"c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27\": rpc error: code = NotFound desc = could not find container \"c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27\": container with ID starting with c68b5e72c85adf06d17cfd705c2c4d2b614d4c97b6f0f59e0766ae0e8464bf27 not found: ID does not exist" Jul 03 17:37:30.207971 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.207950 2580 scope.go:117] "RemoveContainer" containerID="de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd" Jul 03 17:37:30.208187 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:30.208173 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd\": container with ID starting with de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd not found: ID does not exist" containerID="de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd" Jul 03 17:37:30.208228 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.208191 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd"} err="failed to get container status \"de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd\": rpc error: code = NotFound desc = could not find container \"de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd\": container with ID starting with de6bc160ab8a981cefddc580a29fa495331e13a404cbae49571e608364d174cd not found: ID does not exist" Jul 03 17:37:30.208228 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.208203 2580 scope.go:117] "RemoveContainer" containerID="c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474" Jul 03 17:37:30.208475 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:30.208451 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474\": container with ID starting with c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474 not found: ID does not exist" containerID="c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474" Jul 03 17:37:30.208523 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.208469 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474"} err="failed to get container status \"c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474\": rpc error: code = NotFound desc = could not find container \"c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474\": container with ID starting with c28170537abac376fe9f3f55667050854c8899a8739cf6ed1aeb203ef15f4474 not found: ID does not exist" Jul 03 17:37:30.213958 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.213934 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:30.214208 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214196 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="init-config-reloader" Jul 03 17:37:30.214271 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214210 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="init-config-reloader" Jul 03 17:37:30.214271 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214220 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-metric" Jul 03 17:37:30.214271 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214225 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-metric" Jul 03 17:37:30.214271 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214234 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="config-reloader" Jul 03 17:37:30.214271 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214239 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="config-reloader" Jul 03 17:37:30.214271 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214263 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy" Jul 03 17:37:30.214271 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214269 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214278 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-web" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214284 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-web" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214294 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="prom-label-proxy" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214299 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="prom-label-proxy" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214305 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="alertmanager" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214309 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="alertmanager" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214354 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="alertmanager" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214362 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="config-reloader" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214367 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-web" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214373 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy-metric" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214379 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="kube-rbac-proxy" Jul 03 17:37:30.214546 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.214384 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1e80d4-ae0b-4bdd-ad9c-d72202d06754" containerName="prom-label-proxy" Jul 03 17:37:30.217760 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.217744 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.221436 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.221421 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 17:37:30.221522 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.221461 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 17:37:30.222216 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.222199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 17:37:30.222337 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.222276 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 17:37:30.222337 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.222294 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 17:37:30.222446 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.222399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 17:37:30.222581 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.222568 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 17:37:30.222671 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.222654 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nrft5\"" Jul 03 17:37:30.223173 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.223156 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 17:37:30.229540 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.229522 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 17:37:30.233602 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.233584 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:30.337497 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lffzf\" (UniqueName: \"kubernetes.io/projected/09a71f94-7e72-4c4b-8bbe-fed76e62a999-kube-api-access-lffzf\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.337696 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.337696 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09a71f94-7e72-4c4b-8bbe-fed76e62a999-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.337696 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.337696 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09a71f94-7e72-4c4b-8bbe-fed76e62a999-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.337696 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09a71f94-7e72-4c4b-8bbe-fed76e62a999-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.337696 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.338029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.338029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-config-volume\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.338029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09a71f94-7e72-4c4b-8bbe-fed76e62a999-config-out\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.338029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-web-config\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.338029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.338029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.337876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09a71f94-7e72-4c4b-8bbe-fed76e62a999-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.438943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-config-volume\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.438973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09a71f94-7e72-4c4b-8bbe-fed76e62a999-config-out\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.438990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-web-config\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439029 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439009 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439369 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09a71f94-7e72-4c4b-8bbe-fed76e62a999-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439369 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lffzf\" (UniqueName: \"kubernetes.io/projected/09a71f94-7e72-4c4b-8bbe-fed76e62a999-kube-api-access-lffzf\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439369 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439369 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09a71f94-7e72-4c4b-8bbe-fed76e62a999-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439369 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439369 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09a71f94-7e72-4c4b-8bbe-fed76e62a999-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439659 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439406 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09a71f94-7e72-4c4b-8bbe-fed76e62a999-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439659 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439435 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.439659 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.439469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.440101 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.440067 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09a71f94-7e72-4c4b-8bbe-fed76e62a999-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.440633 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.440505 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09a71f94-7e72-4c4b-8bbe-fed76e62a999-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.440982 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.440957 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/09a71f94-7e72-4c4b-8bbe-fed76e62a999-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.442524 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.442425 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-web-config\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.442524 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.442504 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-config-volume\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.442747 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.442722 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/09a71f94-7e72-4c4b-8bbe-fed76e62a999-config-out\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.442843 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.442817 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.442974 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.442951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.443102 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.443074 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.443400 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.443385 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/09a71f94-7e72-4c4b-8bbe-fed76e62a999-tls-assets\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.443400 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.443392 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.444107 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.444091 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/09a71f94-7e72-4c4b-8bbe-fed76e62a999-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.448073 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.448057 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lffzf\" (UniqueName: \"kubernetes.io/projected/09a71f94-7e72-4c4b-8bbe-fed76e62a999-kube-api-access-lffzf\") pod \"alertmanager-main-0\" (UID: \"09a71f94-7e72-4c4b-8bbe-fed76e62a999\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.527500 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.527468 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:30.669334 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:30.669311 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:30.671437 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:37:30.671410 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a71f94_7e72_4c4b_8bbe_fed76e62a999.slice/crio-72b76f644d4e6f938d8eea27e23655dff61c247d3a2117621f657291b6239aa5 WatchSource:0}: Error finding container 72b76f644d4e6f938d8eea27e23655dff61c247d3a2117621f657291b6239aa5: Status 404 returned error can't find the container with id 72b76f644d4e6f938d8eea27e23655dff61c247d3a2117621f657291b6239aa5 Jul 03 17:37:31.156434 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:31.156355 2580 generic.go:356] "Generic (PLEG): container finished" podID="09a71f94-7e72-4c4b-8bbe-fed76e62a999" containerID="5b73403e283293328d12ef840cb4cf7b0492ae79ba1324796ffd7371c2829a4d" exitCode=0 Jul 03 17:37:31.156434 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:31.156419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerDied","Data":"5b73403e283293328d12ef840cb4cf7b0492ae79ba1324796ffd7371c2829a4d"} Jul 03 17:37:31.156806 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:31.156469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerStarted","Data":"72b76f644d4e6f938d8eea27e23655dff61c247d3a2117621f657291b6239aa5"} Jul 03 17:37:32.163656 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.163617 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerStarted","Data":"88b66c09870495b91446b8dba4c32459aeda94936ea62259da8a28662bfa09c8"} Jul 03 17:37:32.164049 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.163734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerStarted","Data":"a29070ebc4865587b54be34cf47c69c118cd4c41bcec87e01508569f3c49948d"} Jul 03 17:37:32.164049 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.163776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerStarted","Data":"7a78f75ac82b998e809b99b2572af22864cffe1377b5558eecc57eda6159a621"} Jul 03 17:37:32.164049 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.163811 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerStarted","Data":"bfbed3f1e99767c7d2a39015ac92a2f12236405a92cb21e60614a8ade08b2468"} Jul 03 17:37:32.164049 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.163847 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerStarted","Data":"b297c8e8b71a40eae0ae0a25fdf8dcb33fc4a4e64f0c78470f0ebd3e3475fd3a"} Jul 03 17:37:32.164049 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.163881 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"09a71f94-7e72-4c4b-8bbe-fed76e62a999","Type":"ContainerStarted","Data":"768463e7530a64a96acefccf89c1c8cabbbe92fd3cce701e219d50d850986ec8"} Jul 03 17:37:32.196994 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.196936 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.181019191 podStartE2EDuration="2.196915707s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.896516ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:37:32.194077602 +0000 UTC m=+196.514333574" watchObservedRunningTime="2026-07-03 17:37:32.196915707 +0000 UTC m=+196.517171658" Jul 03 17:37:32.836069 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.836031 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:32.836364 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.836337 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="prometheus" containerID="cri-o://475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" gracePeriod=600 Jul 03 17:37:32.836452 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.836363 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="thanos-sidecar" containerID="cri-o://57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" gracePeriod=600 Jul 03 17:37:32.836452 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.836399 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-web" containerID="cri-o://00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" gracePeriod=600 Jul 03 17:37:32.836452 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.836344 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy" containerID="cri-o://6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" gracePeriod=600 Jul 03 17:37:32.836452 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.836406 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-thanos" containerID="cri-o://380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" gracePeriod=600 Jul 03 17:37:32.836636 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:32.836421 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="config-reloader" containerID="cri-o://24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" gracePeriod=600 Jul 03 17:37:33.087051 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.086995 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.164493 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.164465 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-kubelet-serving-ca-bundle\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.164948 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.164508 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-serving-certs-ca-bundle\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.164948 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.164534 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-1\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.164948 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.164556 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-2\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.164948 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.164807 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:33.165156 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165002 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:33.165156 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165056 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-thanos-prometheus-http-client-file\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165156 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165119 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165325 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165156 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmmmq\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-kube-api-access-hmmmq\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165325 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165184 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-0\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165325 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165215 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-db\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165325 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165215 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:33.165325 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165289 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-tls\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165325 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165297 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:33.165325 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165323 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-web-config\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165349 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165456 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-metrics-client-certs\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165488 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-metrics-client-ca\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165521 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config-out\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165548 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-grpc-tls\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165576 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-kube-rbac-proxy\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165604 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.165654 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165639 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-trusted-ca-bundle\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.166022 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165664 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-tls-assets\") pod \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\" (UID: \"b2197aea-3dbe-4128-ad8e-a0ce0a644b09\") " Jul 03 17:37:33.166022 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165928 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.166022 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.165947 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.166163 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.166015 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.166163 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.166122 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.166826 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.166796 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:33.167709 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.167662 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:33.168444 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.168415 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:33.169152 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.169124 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.169983 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.169941 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.170289 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.170233 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-kube-api-access-hmmmq" (OuterVolumeSpecName: "kube-api-access-hmmmq") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "kube-api-access-hmmmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:33.170581 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.170555 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.170688 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.170667 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.170824 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.170801 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.170913 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.170886 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:33.171036 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.171014 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.171159 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.171128 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config-out" (OuterVolumeSpecName: "config-out") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:33.171237 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.171195 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config" (OuterVolumeSpecName: "config") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.171237 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.171224 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.174781 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.173944 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:33.179044 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179018 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" exitCode=0 Jul 03 17:37:33.179044 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179037 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" exitCode=0 Jul 03 17:37:33.179044 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179044 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" exitCode=0 Jul 03 17:37:33.179218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179052 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" exitCode=0 Jul 03 17:37:33.179218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179057 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" exitCode=0 Jul 03 17:37:33.179218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179062 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" exitCode=0 Jul 03 17:37:33.179218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} Jul 03 17:37:33.179218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179122 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.179218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179177 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} Jul 03 17:37:33.179218 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} Jul 03 17:37:33.179510 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179234 2580 scope.go:117] "RemoveContainer" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.179510 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179288 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} Jul 03 17:37:33.179510 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} Jul 03 17:37:33.179510 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179372 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} Jul 03 17:37:33.179510 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.179409 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b2197aea-3dbe-4128-ad8e-a0ce0a644b09","Type":"ContainerDied","Data":"7f1ea24efb2d94b7cd54def67dcc50093b9c9a1f7d916a117e254d04a15f5acf"} Jul 03 17:37:33.184212 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.184188 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-web-config" (OuterVolumeSpecName: "web-config") pod "b2197aea-3dbe-4128-ad8e-a0ce0a644b09" (UID: "b2197aea-3dbe-4128-ad8e-a0ce0a644b09"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:33.187070 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.187055 2580 scope.go:117] "RemoveContainer" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.194074 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.194060 2580 scope.go:117] "RemoveContainer" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.200726 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.200709 2580 scope.go:117] "RemoveContainer" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.207216 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.207202 2580 scope.go:117] "RemoveContainer" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.213663 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.213637 2580 scope.go:117] "RemoveContainer" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.220560 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.220544 2580 scope.go:117] "RemoveContainer" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.226948 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.226933 2580 scope.go:117] "RemoveContainer" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.227221 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:33.227204 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": container with ID starting with 380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105 not found: ID does not exist" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.227294 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.227231 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} err="failed to get container status \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": rpc error: code = NotFound desc = could not find container \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": container with ID starting with 380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105 not found: ID does not exist" Jul 03 17:37:33.227294 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.227272 2580 scope.go:117] "RemoveContainer" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.227516 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:33.227497 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": container with ID starting with 6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca not found: ID does not exist" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.227570 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.227523 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} err="failed to get container status \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": rpc error: code = NotFound desc = could not find container \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": container with ID starting with 6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca not found: ID does not exist" Jul 03 17:37:33.227570 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.227540 2580 scope.go:117] "RemoveContainer" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.227788 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:33.227770 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": container with ID starting with 00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101 not found: ID does not exist" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.227862 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.227795 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} err="failed to get container status \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": rpc error: code = NotFound desc = could not find container \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": container with ID starting with 00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101 not found: ID does not exist" Jul 03 17:37:33.227862 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.227814 2580 scope.go:117] "RemoveContainer" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.228031 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:33.228017 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": container with ID starting with 57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049 not found: ID does not exist" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.228066 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228036 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} err="failed to get container status \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": rpc error: code = NotFound desc = could not find container \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": container with ID starting with 57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049 not found: ID does not exist" Jul 03 17:37:33.228066 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228056 2580 scope.go:117] "RemoveContainer" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.228301 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:33.228281 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": container with ID starting with 24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957 not found: ID does not exist" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.228380 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228307 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} err="failed to get container status \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": rpc error: code = NotFound desc = could not find container \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": container with ID starting with 24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957 not found: ID does not exist" Jul 03 17:37:33.228380 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228323 2580 scope.go:117] "RemoveContainer" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.228566 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:33.228549 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": container with ID starting with 475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240 not found: ID does not exist" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.228606 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228571 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} err="failed to get container status \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": rpc error: code = NotFound desc = could not find container \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": container with ID starting with 475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240 not found: ID does not exist" Jul 03 17:37:33.228606 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228585 2580 scope.go:117] "RemoveContainer" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.228809 ip-10-0-137-100 kubenswrapper[2580]: E0703 17:37:33.228792 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": container with ID starting with b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82 not found: ID does not exist" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.228844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228813 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82"} err="failed to get container status \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": rpc error: code = NotFound desc = could not find container \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": container with ID starting with b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82 not found: ID does not exist" Jul 03 17:37:33.228844 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228826 2580 scope.go:117] "RemoveContainer" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.229010 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.228995 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} err="failed to get container status \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": rpc error: code = NotFound desc = could not find container \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": container with ID starting with 380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105 not found: ID does not exist" Jul 03 17:37:33.229051 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229009 2580 scope.go:117] "RemoveContainer" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.229193 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229177 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} err="failed to get container status \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": rpc error: code = NotFound desc = could not find container \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": container with ID starting with 6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca not found: ID does not exist" Jul 03 17:37:33.229230 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229193 2580 scope.go:117] "RemoveContainer" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.229412 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229395 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} err="failed to get container status \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": rpc error: code = NotFound desc = could not find container \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": container with ID starting with 00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101 not found: ID does not exist" Jul 03 17:37:33.229412 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229411 2580 scope.go:117] "RemoveContainer" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.229642 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229616 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} err="failed to get container status \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": rpc error: code = NotFound desc = could not find container \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": container with ID starting with 57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049 not found: ID does not exist" Jul 03 17:37:33.229695 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229643 2580 scope.go:117] "RemoveContainer" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.229861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229845 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} err="failed to get container status \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": rpc error: code = NotFound desc = could not find container \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": container with ID starting with 24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957 not found: ID does not exist" Jul 03 17:37:33.229902 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.229861 2580 scope.go:117] "RemoveContainer" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.230112 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230094 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} err="failed to get container status \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": rpc error: code = NotFound desc = could not find container \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": container with ID starting with 475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240 not found: ID does not exist" Jul 03 17:37:33.230170 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230116 2580 scope.go:117] "RemoveContainer" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.230370 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230354 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82"} err="failed to get container status \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": rpc error: code = NotFound desc = could not find container \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": container with ID starting with b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82 not found: ID does not exist" Jul 03 17:37:33.230424 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230370 2580 scope.go:117] "RemoveContainer" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.230575 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230559 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} err="failed to get container status \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": rpc error: code = NotFound desc = could not find container \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": container with ID starting with 380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105 not found: ID does not exist" Jul 03 17:37:33.230615 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230575 2580 scope.go:117] "RemoveContainer" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.230782 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230764 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} err="failed to get container status \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": rpc error: code = NotFound desc = could not find container \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": container with ID starting with 6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca not found: ID does not exist" Jul 03 17:37:33.230854 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230784 2580 scope.go:117] "RemoveContainer" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.230984 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230967 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} err="failed to get container status \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": rpc error: code = NotFound desc = could not find container \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": container with ID starting with 00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101 not found: ID does not exist" Jul 03 17:37:33.231054 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.230986 2580 scope.go:117] "RemoveContainer" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.231217 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231195 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} err="failed to get container status \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": rpc error: code = NotFound desc = could not find container \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": container with ID starting with 57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049 not found: ID does not exist" Jul 03 17:37:33.231290 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231219 2580 scope.go:117] "RemoveContainer" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.231444 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231426 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} err="failed to get container status \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": rpc error: code = NotFound desc = could not find container \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": container with ID starting with 24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957 not found: ID does not exist" Jul 03 17:37:33.231505 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231445 2580 scope.go:117] "RemoveContainer" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.231636 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231619 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} err="failed to get container status \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": rpc error: code = NotFound desc = could not find container \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": container with ID starting with 475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240 not found: ID does not exist" Jul 03 17:37:33.231681 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231638 2580 scope.go:117] "RemoveContainer" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.231848 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231831 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82"} err="failed to get container status \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": rpc error: code = NotFound desc = could not find container \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": container with ID starting with b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82 not found: ID does not exist" Jul 03 17:37:33.231887 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.231850 2580 scope.go:117] "RemoveContainer" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.232040 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232020 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} err="failed to get container status \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": rpc error: code = NotFound desc = could not find container \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": container with ID starting with 380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105 not found: ID does not exist" Jul 03 17:37:33.232090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232040 2580 scope.go:117] "RemoveContainer" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.232219 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232201 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} err="failed to get container status \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": rpc error: code = NotFound desc = could not find container \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": container with ID starting with 6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca not found: ID does not exist" Jul 03 17:37:33.232286 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232220 2580 scope.go:117] "RemoveContainer" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.232421 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232402 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} err="failed to get container status \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": rpc error: code = NotFound desc = could not find container \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": container with ID starting with 00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101 not found: ID does not exist" Jul 03 17:37:33.232462 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232424 2580 scope.go:117] "RemoveContainer" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.232586 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232568 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} err="failed to get container status \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": rpc error: code = NotFound desc = could not find container \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": container with ID starting with 57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049 not found: ID does not exist" Jul 03 17:37:33.232634 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232589 2580 scope.go:117] "RemoveContainer" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.232769 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232752 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} err="failed to get container status \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": rpc error: code = NotFound desc = could not find container \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": container with ID starting with 24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957 not found: ID does not exist" Jul 03 17:37:33.232815 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232769 2580 scope.go:117] "RemoveContainer" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.232948 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232933 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} err="failed to get container status \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": rpc error: code = NotFound desc = could not find container \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": container with ID starting with 475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240 not found: ID does not exist" Jul 03 17:37:33.232988 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.232948 2580 scope.go:117] "RemoveContainer" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.233164 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233146 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82"} err="failed to get container status \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": rpc error: code = NotFound desc = could not find container \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": container with ID starting with b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82 not found: ID does not exist" Jul 03 17:37:33.233204 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233164 2580 scope.go:117] "RemoveContainer" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.233388 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233367 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} err="failed to get container status \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": rpc error: code = NotFound desc = could not find container \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": container with ID starting with 380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105 not found: ID does not exist" Jul 03 17:37:33.233388 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233386 2580 scope.go:117] "RemoveContainer" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.233554 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233537 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} err="failed to get container status \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": rpc error: code = NotFound desc = could not find container \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": container with ID starting with 6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca not found: ID does not exist" Jul 03 17:37:33.233615 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233555 2580 scope.go:117] "RemoveContainer" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.233774 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233752 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} err="failed to get container status \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": rpc error: code = NotFound desc = could not find container \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": container with ID starting with 00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101 not found: ID does not exist" Jul 03 17:37:33.233774 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233768 2580 scope.go:117] "RemoveContainer" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.234007 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.233990 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} err="failed to get container status \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": rpc error: code = NotFound desc = could not find container \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": container with ID starting with 57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049 not found: ID does not exist" Jul 03 17:37:33.234007 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234007 2580 scope.go:117] "RemoveContainer" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.234210 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234196 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} err="failed to get container status \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": rpc error: code = NotFound desc = could not find container \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": container with ID starting with 24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957 not found: ID does not exist" Jul 03 17:37:33.234281 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234210 2580 scope.go:117] "RemoveContainer" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.234479 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234460 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} err="failed to get container status \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": rpc error: code = NotFound desc = could not find container \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": container with ID starting with 475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240 not found: ID does not exist" Jul 03 17:37:33.234528 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234481 2580 scope.go:117] "RemoveContainer" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.234714 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234686 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82"} err="failed to get container status \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": rpc error: code = NotFound desc = could not find container \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": container with ID starting with b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82 not found: ID does not exist" Jul 03 17:37:33.234765 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234714 2580 scope.go:117] "RemoveContainer" containerID="380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105" Jul 03 17:37:33.234911 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234896 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105"} err="failed to get container status \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": rpc error: code = NotFound desc = could not find container \"380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105\": container with ID starting with 380eeab72760f3d62738881f2f7bf2d9d359db2e85dd1899f74a8cd79f0d7105 not found: ID does not exist" Jul 03 17:37:33.234965 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.234911 2580 scope.go:117] "RemoveContainer" containerID="6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca" Jul 03 17:37:33.235062 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235047 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca"} err="failed to get container status \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": rpc error: code = NotFound desc = could not find container \"6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca\": container with ID starting with 6f2f37b583c560e01df31c0bd1fa5c0f0027f134d8aa105cd8a429679cb8f3ca not found: ID does not exist" Jul 03 17:37:33.235104 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235062 2580 scope.go:117] "RemoveContainer" containerID="00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101" Jul 03 17:37:33.235299 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235279 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101"} err="failed to get container status \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": rpc error: code = NotFound desc = could not find container \"00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101\": container with ID starting with 00e9e369b2feaf41b0f2c0bf89111b35e9b6d9cec533905676ba10f0b421a101 not found: ID does not exist" Jul 03 17:37:33.235299 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235299 2580 scope.go:117] "RemoveContainer" containerID="57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049" Jul 03 17:37:33.235542 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235527 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049"} err="failed to get container status \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": rpc error: code = NotFound desc = could not find container \"57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049\": container with ID starting with 57b98fcac67e6be017be5f06056ed564e998fdb41b166e8020e242fa81da3049 not found: ID does not exist" Jul 03 17:37:33.235542 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235542 2580 scope.go:117] "RemoveContainer" containerID="24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957" Jul 03 17:37:33.235727 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235714 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957"} err="failed to get container status \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": rpc error: code = NotFound desc = could not find container \"24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957\": container with ID starting with 24702b9f2f88a1999916b802428597e566ece321d7259fe5aa17a219a0a28957 not found: ID does not exist" Jul 03 17:37:33.235764 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235728 2580 scope.go:117] "RemoveContainer" containerID="475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240" Jul 03 17:37:33.235948 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235931 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240"} err="failed to get container status \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": rpc error: code = NotFound desc = could not find container \"475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240\": container with ID starting with 475a27292ddd32bb4ab18e9bc3a8047b9cf8a834f44f33d1a4e5f3ecad759240 not found: ID does not exist" Jul 03 17:37:33.235988 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.235948 2580 scope.go:117] "RemoveContainer" containerID="b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82" Jul 03 17:37:33.236175 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.236156 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82"} err="failed to get container status \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": rpc error: code = NotFound desc = could not find container \"b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82\": container with ID starting with b92a07a7a6a0242c88885b1e61df681001f6ad413a699234da45bc3f2a4e3c82 not found: ID does not exist" Jul 03 17:37:33.267530 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267508 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-db\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267533 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267550 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-web-config\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267565 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267579 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-metrics-client-certs\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267589 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-configmap-metrics-client-ca\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267596 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267597 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config-out\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267605 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-grpc-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267613 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-kube-rbac-proxy\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267621 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267629 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267637 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-tls-assets\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267646 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267654 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-config\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267662 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmmmq\" (UniqueName: \"kubernetes.io/projected/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-kube-api-access-hmmmq\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.267768 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.267671 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b2197aea-3dbe-4128-ad8e-a0ce0a644b09-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-100.ec2.internal\" DevicePath \"\"" Jul 03 17:37:33.515551 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.515507 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:33.521140 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.521114 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:33.557536 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557509 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:33.557838 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557825 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-web" Jul 03 17:37:33.557880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557840 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-web" Jul 03 17:37:33.557880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557852 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="thanos-sidecar" Jul 03 17:37:33.557880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557858 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="thanos-sidecar" Jul 03 17:37:33.557880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557867 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="init-config-reloader" Jul 03 17:37:33.557880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557872 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="init-config-reloader" Jul 03 17:37:33.557880 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557881 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="config-reloader" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557886 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="config-reloader" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557895 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="prometheus" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557900 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="prometheus" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557907 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557911 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557919 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-thanos" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557924 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-thanos" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557978 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-web" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557986 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy-thanos" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557991 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="config-reloader" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.557997 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="prometheus" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.558003 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="thanos-sidecar" Jul 03 17:37:33.558055 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.558007 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" containerName="kube-rbac-proxy" Jul 03 17:37:33.563396 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.563367 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.565921 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.565895 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 03 17:37:33.566177 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.566153 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 03 17:37:33.566385 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.566373 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4j60hip1ee9it\"" Jul 03 17:37:33.567084 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.567066 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 03 17:37:33.567857 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.567844 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 03 17:37:33.568043 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.568029 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 03 17:37:33.569123 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569103 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 03 17:37:33.569123 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569120 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 03 17:37:33.569292 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569221 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8xxd6\"" Jul 03 17:37:33.569360 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569300 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 03 17:37:33.569360 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569317 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 03 17:37:33.569464 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569357 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 03 17:37:33.569464 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569441 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 03 17:37:33.569643 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.569628 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 03 17:37:33.572435 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.572418 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 03 17:37:33.577530 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.577512 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 03 17:37:33.578961 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.578947 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 03 17:37:33.583736 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.583718 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:33.670141 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670141 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670374 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670374 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670374 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200bb616-408a-4b0a-b3c9-416c85f791b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670374 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670374 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670374 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-config\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670374 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670571 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670850 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200bb616-408a-4b0a-b3c9-416c85f791b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.670850 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.670601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb2t8\" (UniqueName: \"kubernetes.io/projected/200bb616-408a-4b0a-b3c9-416c85f791b4-kube-api-access-vb2t8\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.771379 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.771379 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.771506 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200bb616-408a-4b0a-b3c9-416c85f791b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.771540 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb2t8\" (UniqueName: \"kubernetes.io/projected/200bb616-408a-4b0a-b3c9-416c85f791b4-kube-api-access-vb2t8\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.771569 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.771599 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.771649 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200bb616-408a-4b0a-b3c9-416c85f791b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.771992 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772030 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772099 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-config\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.772503 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.773028 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.773028 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.772783 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.774532 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.774503 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/200bb616-408a-4b0a-b3c9-416c85f791b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.774861 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.774831 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/200bb616-408a-4b0a-b3c9-416c85f791b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.775011 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.774985 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.775467 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.775443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.775556 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.774995 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.775622 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.775576 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.775739 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.775680 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.775739 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.775705 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.776430 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.776406 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.776925 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.776906 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/200bb616-408a-4b0a-b3c9-416c85f791b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.777112 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.777093 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.777194 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.777177 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-config\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.777676 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.777660 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.777857 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.777840 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/200bb616-408a-4b0a-b3c9-416c85f791b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.781268 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.781224 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb2t8\" (UniqueName: \"kubernetes.io/projected/200bb616-408a-4b0a-b3c9-416c85f791b4-kube-api-access-vb2t8\") pod \"prometheus-k8s-0\" (UID: \"200bb616-408a-4b0a-b3c9-416c85f791b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.872949 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:33.872914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:34.028296 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:34.028188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:34.030842 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:37:34.030815 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200bb616_408a_4b0a_b3c9_416c85f791b4.slice/crio-f03efb50a49ca2744b11c564817e8c89d094ada014d21a474e9c165a40f28b38 WatchSource:0}: Error finding container f03efb50a49ca2744b11c564817e8c89d094ada014d21a474e9c165a40f28b38: Status 404 returned error can't find the container with id f03efb50a49ca2744b11c564817e8c89d094ada014d21a474e9c165a40f28b38 Jul 03 17:37:34.185544 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:34.185509 2580 generic.go:356] "Generic (PLEG): container finished" podID="200bb616-408a-4b0a-b3c9-416c85f791b4" containerID="11346c10755a28d8304a596bba638fd0d74378b845207d58683b5b9ea878f204" exitCode=0 Jul 03 17:37:34.185923 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:34.185579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerDied","Data":"11346c10755a28d8304a596bba638fd0d74378b845207d58683b5b9ea878f204"} Jul 03 17:37:34.185923 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:34.185634 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerStarted","Data":"f03efb50a49ca2744b11c564817e8c89d094ada014d21a474e9c165a40f28b38"} Jul 03 17:37:34.208100 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:34.208075 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2197aea-3dbe-4128-ad8e-a0ce0a644b09" path="/var/lib/kubelet/pods/b2197aea-3dbe-4128-ad8e-a0ce0a644b09/volumes" Jul 03 17:37:35.194525 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:35.194495 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerStarted","Data":"c1eacdf60e38fbaf55d78b428f1607087cba4e413a2076ddafd05f8e15ad70f4"} Jul 03 17:37:35.194869 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:35.194583 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerStarted","Data":"a1f1a36ed24bbd5dd8ffec09ab5e71eff853f13e88757ee624403bfb2d196cde"} Jul 03 17:37:35.194869 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:35.194608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerStarted","Data":"cea1b8b2680db877d3c84b4298c90b727524aa2b8bddf12baa96f259b2777727"} Jul 03 17:37:35.194869 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:35.194634 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerStarted","Data":"d85591ae311f192f66237d5bb328b6fe3164d47d3b0b5cc5dd5e8e5e96dff42d"} Jul 03 17:37:35.194869 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:35.194656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerStarted","Data":"bc872b8ae8d6ac27ed556ffe163575d9f573d601572dbbad6542ec2c6d3462d0"} Jul 03 17:37:35.194869 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:35.194678 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"200bb616-408a-4b0a-b3c9-416c85f791b4","Type":"ContainerStarted","Data":"29479d4fbf6e18c8df2da6aad388015f2652cf2c4976d3be6a0db1d1732dc91e"} Jul 03 17:37:35.226332 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:35.226275 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.207208704 podStartE2EDuration="2.226241917s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.033213ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:37:35.22387853 +0000 UTC m=+199.544134492" watchObservedRunningTime="2026-07-03 17:37:35.226241917 +0000 UTC m=+199.546497866" Jul 03 17:37:38.873074 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:37:38.873033 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:38:33.874054 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:38:33.874017 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:38:33.890113 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:38:33.890086 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:38:34.447539 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:38:34.447514 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:39:16.059305 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:16.059273 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 17:39:53.705988 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:53.705960 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5t7jg_8002d112-70a9-4ece-9123-5194f18b80b2/global-pull-secret-syncer/0.log" Jul 03 17:39:53.916084 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:53.916054 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zdtk6_4408f24f-2560-4ef2-baf9-995c82169851/konnectivity-agent/0.log" Jul 03 17:39:53.961766 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:53.961691 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-100.ec2.internal_029f0faa0b0023277c3e141aa247e3e5/haproxy/0.log" Jul 03 17:39:57.462545 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.462517 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09a71f94-7e72-4c4b-8bbe-fed76e62a999/alertmanager/0.log" Jul 03 17:39:57.486520 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.486497 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09a71f94-7e72-4c4b-8bbe-fed76e62a999/config-reloader/0.log" Jul 03 17:39:57.511869 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.511840 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09a71f94-7e72-4c4b-8bbe-fed76e62a999/kube-rbac-proxy-web/0.log" Jul 03 17:39:57.541147 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.541125 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09a71f94-7e72-4c4b-8bbe-fed76e62a999/kube-rbac-proxy/0.log" Jul 03 17:39:57.564408 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.564380 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09a71f94-7e72-4c4b-8bbe-fed76e62a999/kube-rbac-proxy-metric/0.log" Jul 03 17:39:57.610851 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.610829 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09a71f94-7e72-4c4b-8bbe-fed76e62a999/prom-label-proxy/0.log" Jul 03 17:39:57.639069 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.639045 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_09a71f94-7e72-4c4b-8bbe-fed76e62a999/init-config-reloader/0.log" Jul 03 17:39:57.714734 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.714648 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-9mq86_e37bf274-09da-483d-a9af-1269e809fe1a/kube-state-metrics/0.log" Jul 03 17:39:57.784765 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.784728 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-9mq86_e37bf274-09da-483d-a9af-1269e809fe1a/kube-rbac-proxy-main/0.log" Jul 03 17:39:57.817449 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.817419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-9mq86_e37bf274-09da-483d-a9af-1269e809fe1a/kube-rbac-proxy-self/0.log" Jul 03 17:39:57.998609 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:57.998528 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ddrht_7752b309-c0db-4a05-b21f-ef83753246a8/node-exporter/0.log" Jul 03 17:39:58.019208 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.019179 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ddrht_7752b309-c0db-4a05-b21f-ef83753246a8/kube-rbac-proxy/0.log" Jul 03 17:39:58.041085 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.041067 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ddrht_7752b309-c0db-4a05-b21f-ef83753246a8/init-textfile/0.log" Jul 03 17:39:58.158334 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.158296 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9j9sz_740d600d-0a1a-4076-8c69-ee593b4a13a9/kube-rbac-proxy-main/0.log" Jul 03 17:39:58.181071 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.181048 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9j9sz_740d600d-0a1a-4076-8c69-ee593b4a13a9/kube-rbac-proxy-self/0.log" Jul 03 17:39:58.204921 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.204898 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9j9sz_740d600d-0a1a-4076-8c69-ee593b4a13a9/openshift-state-metrics/0.log" Jul 03 17:39:58.239387 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.239367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_200bb616-408a-4b0a-b3c9-416c85f791b4/prometheus/0.log" Jul 03 17:39:58.266514 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.266448 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_200bb616-408a-4b0a-b3c9-416c85f791b4/config-reloader/0.log" Jul 03 17:39:58.288031 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.288011 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_200bb616-408a-4b0a-b3c9-416c85f791b4/thanos-sidecar/0.log" Jul 03 17:39:58.310898 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.310875 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_200bb616-408a-4b0a-b3c9-416c85f791b4/kube-rbac-proxy-web/0.log" Jul 03 17:39:58.338656 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.338626 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_200bb616-408a-4b0a-b3c9-416c85f791b4/kube-rbac-proxy/0.log" Jul 03 17:39:58.361361 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.361341 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_200bb616-408a-4b0a-b3c9-416c85f791b4/kube-rbac-proxy-thanos/0.log" Jul 03 17:39:58.389188 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:39:58.389163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_200bb616-408a-4b0a-b3c9-416c85f791b4/init-config-reloader/0.log" Jul 03 17:40:00.930124 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:00.930086 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs"] Jul 03 17:40:00.933550 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:00.933530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:00.935793 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:00.935772 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvq6m\"/\"kube-root-ca.crt\"" Jul 03 17:40:00.936594 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:00.936566 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cvq6m\"/\"default-dockercfg-rxs9f\"" Jul 03 17:40:00.936594 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:00.936566 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvq6m\"/\"openshift-service-ca.crt\"" Jul 03 17:40:00.942025 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:00.942005 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs"] Jul 03 17:40:01.081032 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.080997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-podres\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.081032 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.081034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hjv\" (UniqueName: \"kubernetes.io/projected/9e36a712-53f7-48d9-a44e-30d0ffcfbece-kube-api-access-q2hjv\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.081236 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.081076 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-proc\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.081236 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.081163 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-sys\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.081236 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.081202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-lib-modules\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182530 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-sys\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182530 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-lib-modules\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182681 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-podres\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182681 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hjv\" (UniqueName: \"kubernetes.io/projected/9e36a712-53f7-48d9-a44e-30d0ffcfbece-kube-api-access-q2hjv\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182681 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-proc\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182681 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182580 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-sys\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182681 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182643 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-proc\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182681 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182673 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-podres\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.182859 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.182692 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e36a712-53f7-48d9-a44e-30d0ffcfbece-lib-modules\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.191003 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.190983 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hjv\" (UniqueName: \"kubernetes.io/projected/9e36a712-53f7-48d9-a44e-30d0ffcfbece-kube-api-access-q2hjv\") pod \"perf-node-gather-daemonset-jpccs\" (UID: \"9e36a712-53f7-48d9-a44e-30d0ffcfbece\") " pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.243773 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.243726 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.369339 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.369184 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs"] Jul 03 17:40:01.372159 ip-10-0-137-100 kubenswrapper[2580]: W0703 17:40:01.372134 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e36a712_53f7_48d9_a44e_30d0ffcfbece.slice/crio-373f6c44519fb68fe266670efa84f83593ae11b59d77ba152345c1a25c19f4ae WatchSource:0}: Error finding container 373f6c44519fb68fe266670efa84f83593ae11b59d77ba152345c1a25c19f4ae: Status 404 returned error can't find the container with id 373f6c44519fb68fe266670efa84f83593ae11b59d77ba152345c1a25c19f4ae Jul 03 17:40:01.756584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.756479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" event={"ID":"9e36a712-53f7-48d9-a44e-30d0ffcfbece","Type":"ContainerStarted","Data":"88a8dd63cf4f47ae9711f472f4672c4232a90e5644dd932e45c01b994e8e81fe"} Jul 03 17:40:01.756584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.756541 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" event={"ID":"9e36a712-53f7-48d9-a44e-30d0ffcfbece","Type":"ContainerStarted","Data":"373f6c44519fb68fe266670efa84f83593ae11b59d77ba152345c1a25c19f4ae"} Jul 03 17:40:01.756584 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.756572 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:01.774232 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:01.774186 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" podStartSLOduration=1.7741725320000001 podStartE2EDuration="1.774172532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:40:01.772309203 +0000 UTC m=+346.092565152" watchObservedRunningTime="2026-07-03 17:40:01.774172532 +0000 UTC m=+346.094428483" Jul 03 17:40:02.240090 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:02.240068 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qlw9b_bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e/dns/0.log" Jul 03 17:40:02.261322 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:02.261300 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qlw9b_bb3a6b47-9a3c-4f14-8a90-2836fa3c3b3e/kube-rbac-proxy/0.log" Jul 03 17:40:02.311270 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:02.311226 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w8pnp_f06db276-6fb0-40c0-8165-7435c32bce56/dns-node-resolver/0.log" Jul 03 17:40:02.749113 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:02.749086 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xwq7g_6842f315-d716-4374-8fea-3e9904bedea0/node-ca/0.log" Jul 03 17:40:03.432011 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:03.431983 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-864f59f9d9-266vv_9d0fcbd2-5b1c-4d13-a03e-6886513b192e/router/0.log" Jul 03 17:40:03.781845 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:03.781771 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qcb5q_5213ab89-a837-4e59-8088-6496cb842bcb/serve-healthcheck-canary/0.log" Jul 03 17:40:04.232483 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:04.232455 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ndjsz_fd67405f-d619-4fb8-b8cd-d82c417071a5/kube-rbac-proxy/0.log" Jul 03 17:40:04.255021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:04.254995 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ndjsz_fd67405f-d619-4fb8-b8cd-d82c417071a5/exporter/0.log" Jul 03 17:40:04.278021 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:04.278001 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ndjsz_fd67405f-d619-4fb8-b8cd-d82c417071a5/extractor/0.log" Jul 03 17:40:07.769586 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:07.769516 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cvq6m/perf-node-gather-daemonset-jpccs" Jul 03 17:40:08.261094 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:08.261063 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-9thc5_73dbf323-e337-4460-867a-b7044141a7a4/migrator/0.log" Jul 03 17:40:08.280531 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:08.280504 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-9thc5_73dbf323-e337-4460-867a-b7044141a7a4/graceful-termination/0.log" Jul 03 17:40:08.571869 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:08.571782 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-dtfdl_465b40bf-15d5-4b5c-87ae-cf9791f66c6e/kube-storage-version-migrator-operator/1.log" Jul 03 17:40:08.573486 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:08.573459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-dtfdl_465b40bf-15d5-4b5c-87ae-cf9791f66c6e/kube-storage-version-migrator-operator/0.log" Jul 03 17:40:09.664871 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:09.664848 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kskdn_6f227b70-4c03-4104-aeb5-aa4171f93107/kube-multus-additional-cni-plugins/0.log" Jul 03 17:40:09.707587 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:09.707557 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kskdn_6f227b70-4c03-4104-aeb5-aa4171f93107/egress-router-binary-copy/0.log" Jul 03 17:40:09.748661 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:09.748639 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kskdn_6f227b70-4c03-4104-aeb5-aa4171f93107/cni-plugins/0.log" Jul 03 17:40:09.771009 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:09.770980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kskdn_6f227b70-4c03-4104-aeb5-aa4171f93107/bond-cni-plugin/0.log" Jul 03 17:40:09.794708 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:09.794687 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kskdn_6f227b70-4c03-4104-aeb5-aa4171f93107/routeoverride-cni/0.log" Jul 03 17:40:09.815440 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:09.815416 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kskdn_6f227b70-4c03-4104-aeb5-aa4171f93107/whereabouts-cni-bincopy/0.log" Jul 03 17:40:09.836752 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:09.836733 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kskdn_6f227b70-4c03-4104-aeb5-aa4171f93107/whereabouts-cni/0.log" Jul 03 17:40:10.106156 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:10.106125 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zmm5f_f1c51fdf-6465-495e-b7f0-4b669d806963/kube-multus/0.log" Jul 03 17:40:10.130230 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:10.130203 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4zbsx_499876cc-475d-4596-abbe-41169a803961/network-metrics-daemon/0.log" Jul 03 17:40:10.153303 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:10.153281 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4zbsx_499876cc-475d-4596-abbe-41169a803961/kube-rbac-proxy/0.log" Jul 03 17:40:11.240148 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.240120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/ovn-controller/0.log" Jul 03 17:40:11.259317 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.259291 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/ovn-acl-logging/0.log" Jul 03 17:40:11.289196 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.289167 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/kube-rbac-proxy-node/0.log" Jul 03 17:40:11.312925 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.312899 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/kube-rbac-proxy-ovn-metrics/0.log" Jul 03 17:40:11.334962 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.334938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/northd/0.log" Jul 03 17:40:11.359549 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.359527 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/nbdb/0.log" Jul 03 17:40:11.382439 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.382419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/sbdb/0.log" Jul 03 17:40:11.434075 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:11.434051 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwhft_3b3a6808-d8bd-4fa0-a24b-c5669266743b/ovnkube-controller/0.log" Jul 03 17:40:12.664491 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:12.664461 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wfslb_05f5a051-aac3-4958-ad99-7407e07eaf54/network-check-target-container/0.log" Jul 03 17:40:13.532210 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:13.532182 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cjmsq_a4bc56d6-8f16-4505-8d2a-610899c7ee9f/iptables-alerter/0.log" Jul 03 17:40:14.243939 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:14.243912 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-w7sct_e30be182-0566-46d3-b5e0-7b1d64b85375/tuned/0.log" Jul 03 17:40:15.986444 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:15.986416 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-g8hw7_9050e371-68a9-427b-9509-248eb93ea86d/cluster-samples-operator/0.log" Jul 03 17:40:16.001707 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:16.001680 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-g8hw7_9050e371-68a9-427b-9509-248eb93ea86d/cluster-samples-operator-watch/0.log" Jul 03 17:40:16.887052 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:16.886990 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-bgmxl_914a1642-a8b6-438e-a099-db30e0692413/service-ca-operator/1.log" Jul 03 17:40:16.888669 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:16.888647 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-bgmxl_914a1642-a8b6-438e-a099-db30e0692413/service-ca-operator/0.log" Jul 03 17:40:17.200627 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:17.200586 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-758f599c5-bhht2_2776e908-bd82-4485-973d-9c8698d1640d/service-ca-controller/0.log" Jul 03 17:40:17.621701 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:17.621607 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-4p9w6_cb007eaa-4728-4f63-85af-11ee88d805b4/csi-driver/0.log" Jul 03 17:40:17.646443 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:17.646412 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-4p9w6_cb007eaa-4728-4f63-85af-11ee88d805b4/csi-node-driver-registrar/0.log" Jul 03 17:40:17.665889 ip-10-0-137-100 kubenswrapper[2580]: I0703 17:40:17.665860 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-4p9w6_cb007eaa-4728-4f63-85af-11ee88d805b4/csi-liveness-probe/0.log"