Jul 29 10:28:24.322571 ip-10-0-137-188 systemd[1]: Starting Kubernetes Kubelet... Jul 29 10:28:24.767729 ip-10-0-137-188 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:28:24.767729 ip-10-0-137-188 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 10:28:24.767729 ip-10-0-137-188 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:28:24.767729 ip-10-0-137-188 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 10:28:24.767729 ip-10-0-137-188 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:28:24.769805 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.769716 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 10:28:24.774819 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774801 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:24.774819 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774817 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:24.774819 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774824 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774828 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774833 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774836 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774841 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774845 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774849 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774852 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774856 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774860 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774864 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774870 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774873 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774877 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774881 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774884 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774896 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774900 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774904 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774908 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:24.775022 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774911 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774915 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774919 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774923 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774927 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774930 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774934 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774939 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774943 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774948 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774952 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774957 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774961 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774966 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774971 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774975 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774981 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774985 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774989 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774994 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:24.775909 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.774998 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775002 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775007 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775011 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775023 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775027 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775031 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775035 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775039 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775043 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775047 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775051 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775056 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775060 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775064 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775068 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775074 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775080 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775084 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775089 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:24.776899 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775093 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775097 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775102 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775107 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775111 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775115 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775120 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775124 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775129 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775135 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775140 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775144 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775148 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775153 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775161 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775167 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775172 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775176 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775181 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775186 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:24.777476 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775190 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775194 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775198 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775202 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775207 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775213 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775218 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775223 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775228 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775232 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775237 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775241 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775246 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775250 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775255 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775260 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.775264 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776412 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776423 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:24.778165 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776427 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776431 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776436 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776441 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776446 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776450 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776457 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776463 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776468 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776473 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776477 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776482 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776486 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776490 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776494 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776499 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776503 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776507 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776511 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776515 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:24.778771 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776519 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776524 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776528 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776533 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776538 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776544 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776549 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776554 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776558 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776563 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776567 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776571 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776575 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776579 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776584 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776588 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776593 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776598 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776602 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:24.779324 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776606 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776610 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776614 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776620 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776624 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776628 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776632 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776636 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776640 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776644 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776648 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776652 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776657 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776661 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776666 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776670 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776674 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776678 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776682 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:24.779803 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776686 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776691 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776695 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776699 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776703 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776708 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776712 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776716 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776720 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776724 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776728 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776741 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776746 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776750 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776754 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776758 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776762 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776766 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776770 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776774 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:24.780269 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776778 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776783 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776787 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776791 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776795 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776800 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776804 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776810 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776814 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776819 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776823 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776827 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776831 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776836 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776843 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776848 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776853 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776858 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.776862 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:24.780787 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778177 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778189 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778195 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778200 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778207 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778212 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778217 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778222 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778227 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778232 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778236 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778241 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778245 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778250 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778254 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778258 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778262 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778267 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778271 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:24.781246 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778275 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778300 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778308 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778313 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778317 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778322 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778327 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778331 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778335 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778341 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778346 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778351 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778355 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778359 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778363 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778368 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778372 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778376 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778382 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778386 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:24.781720 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778390 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778394 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778399 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778403 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778407 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778411 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778415 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778451 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778457 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778465 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778468 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778471 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778474 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778477 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778480 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778483 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778485 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778488 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778491 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778493 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:24.782197 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778496 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778499 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778502 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778505 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778508 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778510 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778513 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778515 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778518 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778520 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778523 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778526 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778528 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778531 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778535 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778538 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778541 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778543 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778546 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:24.782705 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778549 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778553 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778556 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778558 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778561 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778563 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778566 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778569 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778571 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778574 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778576 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778579 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778581 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778584 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778586 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778589 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778593 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778596 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778599 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:24.783168 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778603 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.778607 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778676 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778683 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778690 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778694 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778699 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778702 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778706 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778710 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778713 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778716 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778719 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778725 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778728 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778732 2580 flags.go:64] FLAG: --cgroup-root="" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778735 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778738 2580 flags.go:64] FLAG: --client-ca-file="" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778742 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778744 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778748 2580 flags.go:64] FLAG: --cluster-domain="" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778751 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778754 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778758 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 10:28:24.783648 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778761 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778764 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778768 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778771 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778774 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778778 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778781 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778784 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778787 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778790 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778794 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778797 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778800 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778803 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778806 2580 flags.go:64] FLAG: --enable-server="true" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778808 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778813 2580 flags.go:64] FLAG: --event-burst="100" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778816 2580 flags.go:64] FLAG: --event-qps="50" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778819 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778822 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778825 2580 flags.go:64] FLAG: --eviction-hard="" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778831 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778834 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778837 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778840 2580 flags.go:64] FLAG: --eviction-soft="" Jul 29 10:28:24.784245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778843 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778846 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778849 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778852 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778855 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778858 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778861 2580 flags.go:64] FLAG: --feature-gates="" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778865 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778867 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778871 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778874 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778877 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778880 2580 flags.go:64] FLAG: --help="false" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778882 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-188.ec2.internal" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778885 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778888 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778891 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778895 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778898 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778901 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778903 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778906 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778909 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 10:28:24.784910 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778912 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778915 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778917 2580 flags.go:64] FLAG: --kube-reserved="" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778921 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778923 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778932 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778934 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778938 2580 flags.go:64] FLAG: --lock-file="" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778941 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778944 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778947 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778953 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778956 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778959 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778962 2580 flags.go:64] FLAG: --logging-format="text" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778964 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778968 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778970 2580 flags.go:64] FLAG: --manifest-url="" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778973 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778978 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778980 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778984 2580 flags.go:64] FLAG: --max-pods="110" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778987 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778990 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778993 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 10:28:24.785540 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.778997 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779000 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779003 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779006 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779012 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779015 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779018 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779021 2580 flags.go:64] FLAG: --pod-cidr="" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779024 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779029 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779032 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779035 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779039 2580 flags.go:64] FLAG: --port="10250" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779044 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779047 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc6d5e8f52c2bc57" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779050 2580 flags.go:64] FLAG: --qos-reserved="" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779053 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779056 2580 flags.go:64] FLAG: --register-node="true" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779060 2580 flags.go:64] FLAG: --register-with-taints="" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779063 2580 flags.go:64] FLAG: --registry-burst="10" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779066 2580 flags.go:64] FLAG: --registry-qps="5" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779069 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779072 2580 flags.go:64] FLAG: --reserved-memory="" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779076 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779079 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 10:28:24.786178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779082 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779085 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779088 2580 flags.go:64] FLAG: --runonce="false" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779090 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779094 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779097 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779100 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779103 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779106 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779109 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779112 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779115 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779117 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779120 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779123 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779126 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779129 2580 flags.go:64] FLAG: --system-cgroups="" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779132 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779137 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779141 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779145 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779149 2580 flags.go:64] FLAG: --tls-min-version="" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779152 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779154 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779157 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 10:28:24.786822 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779161 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779164 2580 flags.go:64] FLAG: --v="2" Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779168 2580 flags.go:64] FLAG: --version="false" Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779172 2580 flags.go:64] FLAG: --vmodule="" Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779176 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.779179 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779307 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779311 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779314 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779318 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779321 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779324 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779327 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779330 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779334 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779337 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779339 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779342 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779345 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779347 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779350 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:24.787449 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779352 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779355 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779358 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779360 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779363 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779367 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779371 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779374 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779376 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779379 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779381 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779384 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779387 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779390 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779392 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779395 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779397 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779400 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779403 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779406 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:24.787967 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779408 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779410 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779413 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779416 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779418 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779421 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779423 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779426 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779429 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779431 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779434 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779436 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779439 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779441 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779444 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779447 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779449 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779451 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779456 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779459 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:24.788513 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779461 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779464 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779466 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779469 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779472 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779477 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779480 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779483 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779486 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779489 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779492 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779495 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779497 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779500 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779502 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779505 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779507 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779510 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779513 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:24.789025 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779517 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779519 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779522 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779525 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779528 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779530 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779533 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779535 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779538 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779540 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779543 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779547 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779550 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779553 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779557 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779560 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779562 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779565 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779567 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779571 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:24.789500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779573 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779576 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779578 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779581 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.779584 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.780375 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.788419 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.788433 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.788451 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.788457 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788508 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788512 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788516 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788519 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788522 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:24.789991 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788524 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788527 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788530 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788532 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788535 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788538 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788540 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788543 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788546 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788548 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788551 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788553 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788556 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788560 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788564 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788566 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788569 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788572 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788574 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788577 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:24.790416 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788580 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788582 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788585 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788587 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788591 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788594 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788597 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788600 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788602 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788605 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788608 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788610 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788613 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788615 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788618 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788620 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788623 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788626 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788628 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788631 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:24.791051 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788633 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788635 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788638 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788641 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788643 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788646 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788648 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788652 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788656 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788659 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788661 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788665 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788668 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788671 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788673 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788676 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788679 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788682 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788685 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:24.791721 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788687 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788690 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788692 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788695 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788697 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788700 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788702 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788705 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788707 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788710 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788712 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788716 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788720 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788722 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788725 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788728 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788738 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788741 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788743 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788746 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:24.792177 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788749 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788751 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788754 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788756 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788759 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788761 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788764 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788766 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788769 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788772 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788774 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788778 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788780 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788783 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788786 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:24.792682 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.788791 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788906 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788912 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788917 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788920 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788923 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788926 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788928 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788931 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788934 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788936 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788939 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788941 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788944 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788946 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788949 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788951 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788954 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788957 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:28:24.793064 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788959 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788962 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788964 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788967 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788969 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788972 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788974 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788977 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788980 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788982 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788985 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788988 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788990 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788993 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788995 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.788997 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789000 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789002 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789005 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789007 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:28:24.793668 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789010 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789012 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789014 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789017 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789020 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789022 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789024 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789027 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789030 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789032 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789035 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789038 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789041 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789043 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789047 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789050 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789053 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789055 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789058 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789060 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:28:24.794192 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789063 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789065 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789068 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789070 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789073 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789076 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789078 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789081 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789083 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789085 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789088 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789090 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789093 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789095 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789098 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789100 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789102 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789105 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789107 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789110 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:28:24.794706 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789112 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789116 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789119 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789122 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789125 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789128 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789130 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789133 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789135 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789138 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789141 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789143 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789146 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789148 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789150 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789153 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789156 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789158 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789161 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789163 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:28:24.795231 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:24.789166 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:28:24.795768 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.789170 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:28:24.795768 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.789257 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 10:28:24.795768 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.792835 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 10:28:24.795768 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.795499 2580 server.go:1019] "Starting client certificate rotation" Jul 29 10:28:24.795768 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.795611 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:28:24.796393 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.796379 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:28:24.799201 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.799185 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:28:24.804076 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.804058 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:28:24.813448 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.813433 2580 log.go:25] "Validated CRI v1 runtime API" Jul 29 10:28:24.815761 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.815746 2580 log.go:25] "Validated CRI v1 image API" Jul 29 10:28:24.816583 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.816567 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 10:28:24.819169 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.819148 2580 fs.go:135] Filesystem UUIDs: map[397be220-52f7-4727-bd2f-3f2d79b6b601:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b63e8409-7b58-44b2-8273-587a8a645d09:/dev/nvme0n1p4] Jul 29 10:28:24.819253 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.819168 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 10:28:24.825355 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.825237 2580 manager.go:216] Machine: {Timestamp:2026-07-29 10:28:24.823812574 +0000 UTC m=+0.363277948 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097281 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2d7d5c63734a3b353b6eb276bf4f SystemUUID:ec2f2d7d-5c63-734a-3b35-3b6eb276bf4f BootID:9d9756a6-9fbe-4162-a9c8-4c655bb177e9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:26:fc:14:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:26:fc:14:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:ea:66:f3:4c:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 10:28:24.825355 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.825347 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 10:28:24.825515 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.825450 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 10:28:24.828349 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.828333 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:28:24.828895 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.828868 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 10:28:24.829035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.828898 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 10:28:24.829701 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.829691 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 10:28:24.829739 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.829703 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 10:28:24.829739 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.829710 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:28:24.829739 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.829725 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:28:24.831032 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.831022 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 10:28:24.833938 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.833927 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:28:24.834052 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834042 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 10:28:24.834081 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834073 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 29 10:28:24.834108 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834086 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 10:28:24.834108 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834096 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 10:28:24.834108 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834104 2580 kubelet.go:398] "Adding apiserver pod source" Jul 29 10:28:24.834200 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834112 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 10:28:24.834499 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834486 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:28:24.834562 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.834505 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:28:24.838351 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.838328 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 10:28:24.841042 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.841029 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 10:28:24.841105 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.841059 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 10:28:24.843021 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843009 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 10:28:24.843070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843026 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 10:28:24.843070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843032 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 10:28:24.843070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843037 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 10:28:24.843070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843046 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 10:28:24.843070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843051 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 10:28:24.843070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843058 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 10:28:24.843070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843066 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 10:28:24.843310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843075 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 10:28:24.843310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843080 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 10:28:24.843310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843089 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 10:28:24.843310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843094 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 10:28:24.843951 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843940 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 10:28:24.843988 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.843956 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 10:28:24.844942 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.844918 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 10:28:24.845005 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.844918 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 10:28:24.847077 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.847065 2580 server.go:1268] "Started kubelet" Jul 29 10:28:24.847191 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.847138 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 10:28:24.847358 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.847216 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 10:28:24.847358 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.847317 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 10:28:24.847502 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.847390 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-188.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 10:28:24.847860 ip-10-0-137-188 systemd[1]: Started Kubernetes Kubelet. Jul 29 10:28:24.849628 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.849596 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7dh9" Jul 29 10:28:24.849764 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.849747 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 29 10:28:24.849979 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.849950 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 10:28:24.852699 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.852682 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 10:28:24.856494 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.855337 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-188.ec2.internal.18c6bbe7677c9c1f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-188.ec2.internal,UID:ip-10-0-137-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-188.ec2.internal,},FirstTimestamp:2026-07-29 10:28:24.847039519 +0000 UTC m=+0.386504892,LastTimestamp:2026-07-29 10:28:24.847039519 +0000 UTC m=+0.386504892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-188.ec2.internal,}" Jul 29 10:28:24.857559 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.857541 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7dh9" Jul 29 10:28:24.859410 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.859393 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 10:28:24.859410 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.859405 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 10:28:24.859688 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.859669 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:24.860988 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.860965 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 10:28:24.860988 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.860991 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 10:28:24.861137 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861095 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 10:28:24.861137 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861115 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 29 10:28:24.861137 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861127 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 29 10:28:24.861428 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861338 2580 factory.go:55] Registering systemd factory Jul 29 10:28:24.861428 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861355 2580 factory.go:223] Registration of the systemd container factory successfully Jul 29 10:28:24.861697 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861684 2580 factory.go:153] Registering CRI-O factory Jul 29 10:28:24.861777 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861720 2580 factory.go:223] Registration of the crio container factory successfully Jul 29 10:28:24.861835 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861786 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 10:28:24.861835 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861813 2580 factory.go:103] Registering Raw factory Jul 29 10:28:24.861835 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.861828 2580 manager.go:1196] Started watching for new ooms in manager Jul 29 10:28:24.862117 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.862093 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 10:28:24.862255 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.862240 2580 manager.go:349] Starting recovery of all containers Jul 29 10:28:24.862366 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.862345 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 10:28:24.873690 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.873673 2580 manager.go:354] Recovery completed Jul 29 10:28:24.879220 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.879208 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:24.883054 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.883035 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:24.883121 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.883069 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:24.883121 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.883083 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:24.883671 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.883655 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 10:28:24.883671 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.883667 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 10:28:24.883803 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.883682 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:28:24.883803 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.883729 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:24.884863 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.884844 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:24.884928 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.884879 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:24.884928 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.884897 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:24.886433 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.886421 2580 policy_none.go:49] "None policy: Start" Jul 29 10:28:24.886433 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.886436 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 10:28:24.886561 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.886446 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 10:28:24.888501 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:24.888484 2580 policy_none.go:47] "Start" Jul 29 10:28:24.960780 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:24.960753 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:25.003196 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.003157 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 10:28:25.004336 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.004316 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 10:28:25.004428 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.004363 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 10:28:25.004428 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.004391 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 10:28:25.004522 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.004431 2580 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 29 10:28:25.006427 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.006407 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:28:25.034981 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.034940 2580 manager.go:337] "Starting Device Plugin manager" Jul 29 10:28:25.034981 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.034975 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 10:28:25.035111 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.034989 2580 server.go:87] "Starting device plugin registration server" Jul 29 10:28:25.035259 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.035247 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 10:28:25.035324 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.035262 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 10:28:25.035372 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.035325 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 10:28:25.035471 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.035453 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 10:28:25.035471 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.035466 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 10:28:25.035934 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.035911 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 10:28:25.036019 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.035971 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:25.066968 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.066835 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-188.ec2.internal\" not found" node="ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.104963 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.104935 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal"] Jul 29 10:28:25.105046 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.105023 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:25.105930 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.105914 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:25.106014 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.105946 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:25.106014 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.105959 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:25.108309 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.108297 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:25.108413 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.108399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.108459 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.108428 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:25.109060 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.109043 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:25.109140 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.109069 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:25.109140 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.109083 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:25.109140 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.109049 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:25.109140 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.109135 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:25.109348 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.109145 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:25.111415 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.111400 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.111498 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.111430 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:25.112078 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.112054 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:25.112150 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.112085 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:25.112150 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.112096 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:25.133944 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.133923 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-188.ec2.internal\" not found" node="ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.135798 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.135784 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:28:25.136785 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.136634 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:28:25.136785 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.136659 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:28:25.136785 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.136673 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:28:25.136785 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.136695 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.138398 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.138382 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-188.ec2.internal\" not found" node="ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.141477 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.141463 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.141519 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.141483 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-188.ec2.internal\": node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:25.151648 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.151628 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:25.163854 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.163834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fe3d4c265d9deaaa9b093db00714d9f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-188.ec2.internal\" (UID: \"9fe3d4c265d9deaaa9b093db00714d9f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.163928 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.163857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8987dd7b1ac136e31414dbb5a48a765-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal\" (UID: \"f8987dd7b1ac136e31414dbb5a48a765\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.163928 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.163875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8987dd7b1ac136e31414dbb5a48a765-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal\" (UID: \"f8987dd7b1ac136e31414dbb5a48a765\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.252671 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.252652 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:25.264121 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.264092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8987dd7b1ac136e31414dbb5a48a765-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal\" (UID: \"f8987dd7b1ac136e31414dbb5a48a765\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.264190 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.264126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8987dd7b1ac136e31414dbb5a48a765-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal\" (UID: \"f8987dd7b1ac136e31414dbb5a48a765\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.264190 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.264143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fe3d4c265d9deaaa9b093db00714d9f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-188.ec2.internal\" (UID: \"9fe3d4c265d9deaaa9b093db00714d9f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.264190 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.264169 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9fe3d4c265d9deaaa9b093db00714d9f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-188.ec2.internal\" (UID: \"9fe3d4c265d9deaaa9b093db00714d9f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.264329 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.264197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8987dd7b1ac136e31414dbb5a48a765-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal\" (UID: \"f8987dd7b1ac136e31414dbb5a48a765\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.264329 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.264207 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8987dd7b1ac136e31414dbb5a48a765-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal\" (UID: \"f8987dd7b1ac136e31414dbb5a48a765\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.353484 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.353431 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:25.437003 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.436972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.442372 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:25.441996 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" Jul 29 10:28:25.454447 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.454430 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:25.555024 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:25.554996 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:27.105129 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:27.105102 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:27.205661 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:27.205631 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:27.244189 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.244158 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 10:28:27.244658 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.244340 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 10:28:27.306251 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:27.306220 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:27.314684 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.314654 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 10:23:26 +0000 UTC" deadline="2028-04-12 21:56:22.998665428 +0000 UTC" Jul 29 10:28:27.314684 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.314679 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14963h27m55.683989405s" Jul 29 10:28:27.406608 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:27.406572 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:27.425123 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.425099 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:28:27.455570 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:27.455538 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8987dd7b1ac136e31414dbb5a48a765.slice/crio-edc354ed9ae7804ee1c565d8553753b6a8c3dd6086802b212db1f62c0ea16f69 WatchSource:0}: Error finding container edc354ed9ae7804ee1c565d8553753b6a8c3dd6086802b212db1f62c0ea16f69: Status 404 returned error can't find the container with id edc354ed9ae7804ee1c565d8553753b6a8c3dd6086802b212db1f62c0ea16f69 Jul 29 10:28:27.455815 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:27.455794 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe3d4c265d9deaaa9b093db00714d9f.slice/crio-42ebe0f470dca2fb34ab5b786f175fda390a478f73a054fc12cd4e7c90e26bda WatchSource:0}: Error finding container 42ebe0f470dca2fb34ab5b786f175fda390a478f73a054fc12cd4e7c90e26bda: Status 404 returned error can't find the container with id 42ebe0f470dca2fb34ab5b786f175fda390a478f73a054fc12cd4e7c90e26bda Jul 29 10:28:27.460031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.460012 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:28:27.460111 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.460013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" event={"ID":"9fe3d4c265d9deaaa9b093db00714d9f","Type":"ContainerStarted","Data":"42ebe0f470dca2fb34ab5b786f175fda390a478f73a054fc12cd4e7c90e26bda"} Jul 29 10:28:27.461348 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.461329 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" event={"ID":"f8987dd7b1ac136e31414dbb5a48a765","Type":"ContainerStarted","Data":"edc354ed9ae7804ee1c565d8553753b6a8c3dd6086802b212db1f62c0ea16f69"} Jul 29 10:28:27.507066 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:27.507043 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-188.ec2.internal\" not found" Jul 29 10:28:27.514021 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.513998 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:28:27.552197 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.552179 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:28:27.609604 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.609548 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" Jul 29 10:28:27.621054 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.621032 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:28:27.621942 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.621928 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" Jul 29 10:28:27.628459 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:27.628447 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:28:28.285013 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.284879 2580 apiserver.go:52] "Watching apiserver" Jul 29 10:28:28.285013 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.284927 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:28:28.294080 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.293927 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 10:28:28.294439 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.294414 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng","openshift-cluster-node-tuning-operator/tuned-pcvqf","openshift-dns/node-resolver-6vqwz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal","openshift-multus/multus-64p6z","openshift-network-operator/iptables-alerter-hjkqh","kube-system/global-pull-secret-syncer-spzhb","kube-system/konnectivity-agent-slrcg","kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal","openshift-image-registry/node-ca-j9rws","openshift-multus/multus-additional-cni-plugins-5ct4t","openshift-multus/network-metrics-daemon-ccg6m","openshift-network-diagnostics/network-check-target-pk245","openshift-ovn-kubernetes/ovnkube-node-64gmd"] Jul 29 10:28:28.296906 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.296887 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.299283 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.299261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:28.299381 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.299345 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:28.299978 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.299953 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 10:28:28.300068 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.300038 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 10:28:28.300261 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.300244 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 10:28:28.300338 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.300311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dzstd\"" Jul 29 10:28:28.301120 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.301101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.303513 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.303430 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.304207 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.303923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 10:28:28.304207 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.303957 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 10:28:28.304207 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.304063 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x4d6r\"" Jul 29 10:28:28.305944 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.305924 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.306470 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.306449 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 10:28:28.306698 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.306679 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 10:28:28.307956 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.307934 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 10:28:28.308041 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.307965 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 10:28:28.308135 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.308119 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bzm6b\"" Jul 29 10:28:28.308328 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.308315 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 10:28:28.308379 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.308355 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 10:28:28.308537 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.308520 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.308675 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.308656 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 10:28:28.308943 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.308924 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 10:28:28.309016 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.308928 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pvj7l\"" Jul 29 10:28:28.309557 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.309537 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 10:28:28.309727 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.309713 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 10:28:28.310459 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.309872 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 10:28:28.311189 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.310726 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.311898 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.311326 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:28:28.311898 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.311360 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 10:28:28.311898 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.311390 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 10:28:28.311898 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.311677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dd4qn\"" Jul 29 10:28:28.313166 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.313007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.313166 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.313088 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:28.313663 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.313643 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 10:28:28.313743 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.313661 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 10:28:28.314380 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.314357 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zfqdm\"" Jul 29 10:28:28.316916 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.316317 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.319216 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.319196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-52mkr\"" Jul 29 10:28:28.319594 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.319561 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:28:28.319753 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.319734 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 10:28:28.319966 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.319948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.322125 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322098 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-node-log\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322209 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-run-ovn-kubernetes\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322209 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-cni-bin\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322209 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-cni-netd\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322345 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-cni-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.322345 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-os-release\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.322345 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/022b842d-1c95-4199-8b1a-39a5ab456151-cni-binary-copy\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.322345 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-k8s-cni-cncf-io\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.322531 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-kubelet\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.322531 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aed36b38-366f-4d21-9ce8-41a52305d78a-iptables-alerter-script\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.322531 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aed36b38-366f-4d21-9ce8-41a52305d78a-host-slash\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.322531 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322531 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-cnibin\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.322531 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322499 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-run-netns\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322531 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-ovnkube-config\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-multus-certs\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-dbus\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-tmp-dir\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322597 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f6gmd\"" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322666 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-slash\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-ovnkube-script-lib\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdd860fb-acf4-424b-92e2-518fba7c751b-agent-certs\") pod \"konnectivity-agent-slrcg\" (UID: \"bdd860fb-acf4-424b-92e2-518fba7c751b\") " pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.322869 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-netns\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-hostroot\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b950870a-55fa-47c1-bc20-91cfaee138f4-serviceca\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-env-overrides\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6787dcaa-5c70-413b-9414-acbc2483d422-ovn-node-metrics-cert\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322983 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322965 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.322983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpq89\" (UniqueName: \"kubernetes.io/projected/6787dcaa-5c70-413b-9414-acbc2483d422-kube-api-access-gpq89\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-system-cni-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-cni-multus\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-etc-kubernetes\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b950870a-55fa-47c1-bc20-91cfaee138f4-host\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-hosts-file\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdd860fb-acf4-424b-92e2-518fba7c751b-konnectivity-ca\") pod \"konnectivity-agent-slrcg\" (UID: \"bdd860fb-acf4-424b-92e2-518fba7c751b\") " pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/022b842d-1c95-4199-8b1a-39a5ab456151-multus-daemon-config\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvmbv\" (UniqueName: \"kubernetes.io/projected/022b842d-1c95-4199-8b1a-39a5ab456151-kube-api-access-bvmbv\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.323333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbbrr\" (UniqueName: \"kubernetes.io/projected/aed36b38-366f-4d21-9ce8-41a52305d78a-kube-api-access-qbbrr\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2wr7\" (UniqueName: \"kubernetes.io/projected/b950870a-55fa-47c1-bc20-91cfaee138f4-kube-api-access-v2wr7\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-systemd-units\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-systemd\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-var-lib-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-socket-dir-parent\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-cni-bin\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-conf-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-kubelet-config\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn62b\" (UniqueName: \"kubernetes.io/projected/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-kube-api-access-zn62b\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-log-socket\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-kubelet\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-etc-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.324031 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.323722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-ovn\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.326803 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.326521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.329048 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.329032 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:28.329375 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.329333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:28.329466 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.329374 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 10:28:28.329466 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.329442 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6wgb2\"" Jul 29 10:28:28.329466 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.329379 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 10:28:28.341154 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.341136 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cb488" Jul 29 10:28:28.354233 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.354210 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cb488" Jul 29 10:28:28.411696 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.411672 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 10:28:28.423932 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.423912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-kubelet\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.424051 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.423940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-tuned\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.424051 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.423961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-socket-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.424051 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.423982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/022b842d-1c95-4199-8b1a-39a5ab456151-cni-binary-copy\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.424051 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-k8s-cni-cncf-io\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.424051 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424048 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-kubelet\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.424343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aed36b38-366f-4d21-9ce8-41a52305d78a-host-slash\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.424343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-sys\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.424343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-cnibin\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.424343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysconfig\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.424343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-sys-fs\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.424343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd7lv\" (UniqueName: \"kubernetes.io/projected/5c59a58a-6634-46b6-b5e9-feca01e03035-kube-api-access-fd7lv\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.424343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-dbus\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.424687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-tmp-dir\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.424687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-dbus\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.424687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-ovnkube-script-lib\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.424687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424564 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/022b842d-1c95-4199-8b1a-39a5ab456151-cni-binary-copy\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.424687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-cnibin\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.424687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-k8s-cni-cncf-io\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.424687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-run\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdd860fb-acf4-424b-92e2-518fba7c751b-agent-certs\") pod \"konnectivity-agent-slrcg\" (UID: \"bdd860fb-acf4-424b-92e2-518fba7c751b\") " pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-kubernetes\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-system-cni-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-etc-kubernetes\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b950870a-55fa-47c1-bc20-91cfaee138f4-host\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-systemd\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-run-ovn-kubernetes\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-tmp-dir\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysctl-d\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.424965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6787dcaa-5c70-413b-9414-acbc2483d422-ovn-node-metrics-cert\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpq89\" (UniqueName: \"kubernetes.io/projected/6787dcaa-5c70-413b-9414-acbc2483d422-kube-api-access-gpq89\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdd860fb-acf4-424b-92e2-518fba7c751b-konnectivity-ca\") pod \"konnectivity-agent-slrcg\" (UID: \"bdd860fb-acf4-424b-92e2-518fba7c751b\") " pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.425035 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425035 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-etc-kubernetes\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425005 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-system-cni-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425168 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-ovnkube-script-lib\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/022b842d-1c95-4199-8b1a-39a5ab456151-multus-daemon-config\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvmbv\" (UniqueName: \"kubernetes.io/projected/022b842d-1c95-4199-8b1a-39a5ab456151-kube-api-access-bvmbv\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbbrr\" (UniqueName: \"kubernetes.io/projected/aed36b38-366f-4d21-9ce8-41a52305d78a-kube-api-access-qbbrr\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2wr7\" (UniqueName: \"kubernetes.io/projected/b950870a-55fa-47c1-bc20-91cfaee138f4-kube-api-access-v2wr7\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-systemd-units\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425588 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.425598 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425590 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:28.425692 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdd860fb-acf4-424b-92e2-518fba7c751b-konnectivity-ca\") pod \"konnectivity-agent-slrcg\" (UID: \"bdd860fb-acf4-424b-92e2-518fba7c751b\") " pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.426207 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.425876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-systemd-units\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.426207 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.426030 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret podName:27fd048a-2b59-4ba1-9ae4-a46f2f8a622a nodeName:}" failed. No retries permitted until 2026-07-29 10:28:28.925949865 +0000 UTC m=+3.015842840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret") pod "global-pull-secret-syncer-spzhb" (UID: "27fd048a-2b59-4ba1-9ae4-a46f2f8a622a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:28.426207 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aed36b38-366f-4d21-9ce8-41a52305d78a-host-slash\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.426207 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426124 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-systemd\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.426207 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-run-ovn-kubernetes\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.426475 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-socket-dir-parent\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.426475 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426385 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b950870a-55fa-47c1-bc20-91cfaee138f4-host\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.426475 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-kubelet-config\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.426475 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426487 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/022b842d-1c95-4199-8b1a-39a5ab456151-multus-daemon-config\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-cni-bin\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426517 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-cni-bin\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426566 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-socket-dir-parent\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-host\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426595 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-registration-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.426661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426635 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-kubelet-config\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-node-log\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-systemd\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426767 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-node-log\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cnibin\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6xj\" (UniqueName: \"kubernetes.io/projected/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-kube-api-access-zp6xj\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-cni-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.426994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-os-release\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-kubelet\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aed36b38-366f-4d21-9ce8-41a52305d78a-iptables-alerter-script\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-ovnkube-config\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.427095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-cni-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-os-release\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-modprobe-d\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-kubelet\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-lib-modules\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-etc-selinux\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-run-netns\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-os-release\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427354 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2cj\" (UniqueName: \"kubernetes.io/projected/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-kube-api-access-gd2cj\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427395 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-run-netns\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-multus-certs\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-slash\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-multus-certs\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-ovnkube-config\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-netns\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.427677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-slash\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427649 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aed36b38-366f-4d21-9ce8-41a52305d78a-iptables-alerter-script\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427698 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-run-netns\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-hostroot\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b950870a-55fa-47c1-bc20-91cfaee138f4-serviceca\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-env-overrides\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427770 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-hostroot\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-cni-multus\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-hosts-file\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427902 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-cni-multus\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.427980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-var-lib-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-etc-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428039 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-var-lib-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428050 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-hosts-file\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-ovn\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428086 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-etc-openvswitch\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-run-ovn\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.428503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-cni-netd\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428217 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6787dcaa-5c70-413b-9414-acbc2483d422-env-overrides\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428245 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b950870a-55fa-47c1-bc20-91cfaee138f4-serviceca\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428241 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-log-socket\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428320 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-log-socket\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysctl-conf\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428391 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-tmp\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6787dcaa-5c70-413b-9414-acbc2483d422-host-cni-netd\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6fll\" (UniqueName: \"kubernetes.io/projected/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-kube-api-access-n6fll\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-cni-bin\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-conf-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn62b\" (UniqueName: \"kubernetes.io/projected/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-kube-api-access-zn62b\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-host-var-lib-cni-bin\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-var-lib-kubelet\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-device-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.429331 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428711 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/022b842d-1c95-4199-8b1a-39a5ab456151-multus-conf-dir\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.429934 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.428813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-system-cni-dir\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.429934 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.429430 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6787dcaa-5c70-413b-9414-acbc2483d422-ovn-node-metrics-cert\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.429934 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.429602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdd860fb-acf4-424b-92e2-518fba7c751b-agent-certs\") pod \"konnectivity-agent-slrcg\" (UID: \"bdd860fb-acf4-424b-92e2-518fba7c751b\") " pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.436704 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.436684 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:28:28.436874 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.436712 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:28:28.436874 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.436723 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgwsr for pod openshift-network-diagnostics/network-check-target-pk245: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:28.436874 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.436783 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr podName:3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad nodeName:}" failed. No retries permitted until 2026-07-29 10:28:28.936767252 +0000 UTC m=+3.026660224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fgwsr" (UniqueName: "kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr") pod "network-check-target-pk245" (UID: "3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:28.439460 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.439122 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvmbv\" (UniqueName: \"kubernetes.io/projected/022b842d-1c95-4199-8b1a-39a5ab456151-kube-api-access-bvmbv\") pod \"multus-64p6z\" (UID: \"022b842d-1c95-4199-8b1a-39a5ab456151\") " pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.439582 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.439565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpq89\" (UniqueName: \"kubernetes.io/projected/6787dcaa-5c70-413b-9414-acbc2483d422-kube-api-access-gpq89\") pod \"ovnkube-node-64gmd\" (UID: \"6787dcaa-5c70-413b-9414-acbc2483d422\") " pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.439914 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.439891 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbbrr\" (UniqueName: \"kubernetes.io/projected/aed36b38-366f-4d21-9ce8-41a52305d78a-kube-api-access-qbbrr\") pod \"iptables-alerter-hjkqh\" (UID: \"aed36b38-366f-4d21-9ce8-41a52305d78a\") " pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.440012 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.439951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2wr7\" (UniqueName: \"kubernetes.io/projected/b950870a-55fa-47c1-bc20-91cfaee138f4-kube-api-access-v2wr7\") pod \"node-ca-j9rws\" (UID: \"b950870a-55fa-47c1-bc20-91cfaee138f4\") " pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.440012 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.439987 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn62b\" (UniqueName: \"kubernetes.io/projected/2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f-kube-api-access-zn62b\") pod \"node-resolver-6vqwz\" (UID: \"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f\") " pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.529913 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.529878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.529913 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.529914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysctl-conf\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530119 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.529930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-tmp\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530174 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysctl-conf\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530226 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6fll\" (UniqueName: \"kubernetes.io/projected/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-kube-api-access-n6fll\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530279 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-var-lib-kubelet\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530279 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530255 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-device-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.530390 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-system-cni-dir\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.530390 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-tuned\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530390 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-socket-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.530390 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-sys\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530390 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530367 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-var-lib-kubelet\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530390 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysconfig\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-sys-fs\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-sys\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530435 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd7lv\" (UniqueName: \"kubernetes.io/projected/5c59a58a-6634-46b6-b5e9-feca01e03035-kube-api-access-fd7lv\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-system-cni-dir\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-run\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530484 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-sys-fs\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530486 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-socket-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-kubernetes\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysconfig\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysctl-d\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-kubernetes\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.530653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-run\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-host\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-device-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-registration-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530739 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-sysctl-d\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530747 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-host\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530758 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-systemd\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530785 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-systemd\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cnibin\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530825 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-registration-dir\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530912 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cnibin\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6xj\" (UniqueName: \"kubernetes.io/projected/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-kube-api-access-zp6xj\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-modprobe-d\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.530998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-lib-modules\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.531224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-etc-selinux\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-os-release\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531095 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-modprobe-d\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2cj\" (UniqueName: \"kubernetes.io/projected/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-kube-api-access-gd2cj\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531174 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531190 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c59a58a-6634-46b6-b5e9-feca01e03035-etc-selinux\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531245 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-os-release\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.531267 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531315 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-lib-modules\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531372 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.531410 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs podName:768a1bdd-30a9-4097-8a09-c4b08dfac2d0 nodeName:}" failed. No retries permitted until 2026-07-29 10:28:29.031392427 +0000 UTC m=+3.121285416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs") pod "network-metrics-daemon-ccg6m" (UID: "768a1bdd-30a9-4097-8a09-c4b08dfac2d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:28.532082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.531758 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532589 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.532128 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.532589 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.532474 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-tmp\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.532694 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.532665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-etc-tuned\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.543816 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.543755 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6fll\" (UniqueName: \"kubernetes.io/projected/ad705693-2b4e-4e21-bbf3-55ce0773ddc2-kube-api-access-n6fll\") pod \"tuned-pcvqf\" (UID: \"ad705693-2b4e-4e21-bbf3-55ce0773ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.544205 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.544185 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2cj\" (UniqueName: \"kubernetes.io/projected/13c4ca7d-1f16-4cbb-a2ad-a1732995aea9-kube-api-access-gd2cj\") pod \"multus-additional-cni-plugins-5ct4t\" (UID: \"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9\") " pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.544293 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.544233 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd7lv\" (UniqueName: \"kubernetes.io/projected/5c59a58a-6634-46b6-b5e9-feca01e03035-kube-api-access-fd7lv\") pod \"aws-ebs-csi-driver-node-46tng\" (UID: \"5c59a58a-6634-46b6-b5e9-feca01e03035\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.544293 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.544253 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6xj\" (UniqueName: \"kubernetes.io/projected/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-kube-api-access-zp6xj\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:28.609806 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.609776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j9rws" Jul 29 10:28:28.618370 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.618349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vqwz" Jul 29 10:28:28.630393 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.630368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:28.634967 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.634944 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64p6z" Jul 29 10:28:28.643580 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.643563 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hjkqh" Jul 29 10:28:28.650114 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.650095 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:28.657702 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.657683 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" Jul 29 10:28:28.664370 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.664352 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" Jul 29 10:28:28.669006 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.668989 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" Jul 29 10:28:28.932829 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:28.932755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:28.932994 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.932915 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:28.932994 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:28.932982 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret podName:27fd048a-2b59-4ba1-9ae4-a46f2f8a622a nodeName:}" failed. No retries permitted until 2026-07-29 10:28:29.932962692 +0000 UTC m=+4.022855666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret") pod "global-pull-secret-syncer-spzhb" (UID: "27fd048a-2b59-4ba1-9ae4-a46f2f8a622a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:29.033466 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.033439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:29.033624 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.033488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:29.033624 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.033620 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:29.033746 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.033624 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:28:29.033746 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.033650 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:28:29.033746 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.033663 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgwsr for pod openshift-network-diagnostics/network-check-target-pk245: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:29.033746 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.033673 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs podName:768a1bdd-30a9-4097-8a09-c4b08dfac2d0 nodeName:}" failed. No retries permitted until 2026-07-29 10:28:30.033656354 +0000 UTC m=+4.123549309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs") pod "network-metrics-daemon-ccg6m" (UID: "768a1bdd-30a9-4097-8a09-c4b08dfac2d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:29.033746 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.033719 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr podName:3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad nodeName:}" failed. No retries permitted until 2026-07-29 10:28:30.033700373 +0000 UTC m=+4.123593331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgwsr" (UniqueName: "kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr") pod "network-check-target-pk245" (UID: "3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:29.358115 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.358089 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:23:28 +0000 UTC" deadline="2028-02-11 22:57:22.374491247 +0000 UTC" Jul 29 10:28:29.358115 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.358113 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13500h28m53.016380919s" Jul 29 10:28:29.363521 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.363491 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb950870a_55fa_47c1_bc20_91cfaee138f4.slice/crio-1caecf97e0a1691201960d3d8bf372e36b3627238ec8c14f7ff6064c67426729 WatchSource:0}: Error finding container 1caecf97e0a1691201960d3d8bf372e36b3627238ec8c14f7ff6064c67426729: Status 404 returned error can't find the container with id 1caecf97e0a1691201960d3d8bf372e36b3627238ec8c14f7ff6064c67426729 Jul 29 10:28:29.365506 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.365476 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c4ca7d_1f16_4cbb_a2ad_a1732995aea9.slice/crio-49f2eeda3a61dfb08ac695632befe8601c6626b9813ae3bd4af1dbdb686fa947 WatchSource:0}: Error finding container 49f2eeda3a61dfb08ac695632befe8601c6626b9813ae3bd4af1dbdb686fa947: Status 404 returned error can't find the container with id 49f2eeda3a61dfb08ac695632befe8601c6626b9813ae3bd4af1dbdb686fa947 Jul 29 10:28:29.370350 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.370326 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022b842d_1c95_4199_8b1a_39a5ab456151.slice/crio-37dba075b801c294d9c0dc2afbac8b774b7fdb074fc484767d90d0874c695475 WatchSource:0}: Error finding container 37dba075b801c294d9c0dc2afbac8b774b7fdb074fc484767d90d0874c695475: Status 404 returned error can't find the container with id 37dba075b801c294d9c0dc2afbac8b774b7fdb074fc484767d90d0874c695475 Jul 29 10:28:29.371761 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.371742 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed36b38_366f_4d21_9ce8_41a52305d78a.slice/crio-1f4b1ada0d5e850121a23dce9ef057ef40eb336e57b0661651735769e01914c4 WatchSource:0}: Error finding container 1f4b1ada0d5e850121a23dce9ef057ef40eb336e57b0661651735769e01914c4: Status 404 returned error can't find the container with id 1f4b1ada0d5e850121a23dce9ef057ef40eb336e57b0661651735769e01914c4 Jul 29 10:28:29.373802 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.373785 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad705693_2b4e_4e21_bbf3_55ce0773ddc2.slice/crio-5f132498f594cf2cd6e87127d40824464eb8faca47f4d87a175a45c0c9b0d52a WatchSource:0}: Error finding container 5f132498f594cf2cd6e87127d40824464eb8faca47f4d87a175a45c0c9b0d52a: Status 404 returned error can't find the container with id 5f132498f594cf2cd6e87127d40824464eb8faca47f4d87a175a45c0c9b0d52a Jul 29 10:28:29.374500 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.374385 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd860fb_acf4_424b_92e2_518fba7c751b.slice/crio-f002e7d0de19d678707dc1b9ddc7d9ce85b0021cbbb4d8aef4dde7cfdecdd1f2 WatchSource:0}: Error finding container f002e7d0de19d678707dc1b9ddc7d9ce85b0021cbbb4d8aef4dde7cfdecdd1f2: Status 404 returned error can't find the container with id f002e7d0de19d678707dc1b9ddc7d9ce85b0021cbbb4d8aef4dde7cfdecdd1f2 Jul 29 10:28:29.375451 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.375354 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ead0e0a_0209_4acd_9b7e_0d2a34e74c6f.slice/crio-fc57a83a3fa89e72dee5a7f7f689fed4708d9960e19860c60264953c7f07f50d WatchSource:0}: Error finding container fc57a83a3fa89e72dee5a7f7f689fed4708d9960e19860c60264953c7f07f50d: Status 404 returned error can't find the container with id fc57a83a3fa89e72dee5a7f7f689fed4708d9960e19860c60264953c7f07f50d Jul 29 10:28:29.376508 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.376487 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c59a58a_6634_46b6_b5e9_feca01e03035.slice/crio-d722f0ff4e4a0836942a0e6f0261dc5c8aac9179ac8a837568914f8b8d3a2f41 WatchSource:0}: Error finding container d722f0ff4e4a0836942a0e6f0261dc5c8aac9179ac8a837568914f8b8d3a2f41: Status 404 returned error can't find the container with id d722f0ff4e4a0836942a0e6f0261dc5c8aac9179ac8a837568914f8b8d3a2f41 Jul 29 10:28:29.377439 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:28:29.377351 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6787dcaa_5c70_413b_9414_acbc2483d422.slice/crio-981b286e84957bfebd921d573b27fa5ab8bab3937f05cc53cb3b201af7584bfc WatchSource:0}: Error finding container 981b286e84957bfebd921d573b27fa5ab8bab3937f05cc53cb3b201af7584bfc: Status 404 returned error can't find the container with id 981b286e84957bfebd921d573b27fa5ab8bab3937f05cc53cb3b201af7584bfc Jul 29 10:28:29.455045 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.455018 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:29.455239 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.455063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:29.455239 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.455151 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:29.455344 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.455242 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:29.466112 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.465972 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"981b286e84957bfebd921d573b27fa5ab8bab3937f05cc53cb3b201af7584bfc"} Jul 29 10:28:29.467137 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.467115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" event={"ID":"5c59a58a-6634-46b6-b5e9-feca01e03035","Type":"ContainerStarted","Data":"d722f0ff4e4a0836942a0e6f0261dc5c8aac9179ac8a837568914f8b8d3a2f41"} Jul 29 10:28:29.468255 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.468230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vqwz" event={"ID":"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f","Type":"ContainerStarted","Data":"fc57a83a3fa89e72dee5a7f7f689fed4708d9960e19860c60264953c7f07f50d"} Jul 29 10:28:29.469292 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.469266 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" event={"ID":"ad705693-2b4e-4e21-bbf3-55ce0773ddc2","Type":"ContainerStarted","Data":"5f132498f594cf2cd6e87127d40824464eb8faca47f4d87a175a45c0c9b0d52a"} Jul 29 10:28:29.470443 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.470421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-slrcg" event={"ID":"bdd860fb-acf4-424b-92e2-518fba7c751b","Type":"ContainerStarted","Data":"f002e7d0de19d678707dc1b9ddc7d9ce85b0021cbbb4d8aef4dde7cfdecdd1f2"} Jul 29 10:28:29.471566 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.471544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hjkqh" event={"ID":"aed36b38-366f-4d21-9ce8-41a52305d78a","Type":"ContainerStarted","Data":"1f4b1ada0d5e850121a23dce9ef057ef40eb336e57b0661651735769e01914c4"} Jul 29 10:28:29.472670 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.472650 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64p6z" event={"ID":"022b842d-1c95-4199-8b1a-39a5ab456151","Type":"ContainerStarted","Data":"37dba075b801c294d9c0dc2afbac8b774b7fdb074fc484767d90d0874c695475"} Jul 29 10:28:29.473834 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.473817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerStarted","Data":"49f2eeda3a61dfb08ac695632befe8601c6626b9813ae3bd4af1dbdb686fa947"} Jul 29 10:28:29.475089 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.475069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j9rws" event={"ID":"b950870a-55fa-47c1-bc20-91cfaee138f4","Type":"ContainerStarted","Data":"1caecf97e0a1691201960d3d8bf372e36b3627238ec8c14f7ff6064c67426729"} Jul 29 10:28:29.476995 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.476977 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" event={"ID":"9fe3d4c265d9deaaa9b093db00714d9f","Type":"ContainerStarted","Data":"e491ba598a83dfe36582450cb777cdd4f6fc842005d14be5b4fa17cd2683c6ba"} Jul 29 10:28:29.491455 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.491416 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-188.ec2.internal" podStartSLOduration=2.491406193 podStartE2EDuration="2.491406193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:29.491381122 +0000 UTC m=+3.581274100" watchObservedRunningTime="2026-07-29 10:28:29.491406193 +0000 UTC m=+3.581299171" Jul 29 10:28:29.939560 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:29.938952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:29.939560 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.939089 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:29.939560 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:29.939150 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret podName:27fd048a-2b59-4ba1-9ae4-a46f2f8a622a nodeName:}" failed. No retries permitted until 2026-07-29 10:28:31.939131934 +0000 UTC m=+6.029024894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret") pod "global-pull-secret-syncer-spzhb" (UID: "27fd048a-2b59-4ba1-9ae4-a46f2f8a622a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:30.039775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:30.039836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:30.039988 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:30.040049 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs podName:768a1bdd-30a9-4097-8a09-c4b08dfac2d0 nodeName:}" failed. No retries permitted until 2026-07-29 10:28:32.040031316 +0000 UTC m=+6.129924275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs") pod "network-metrics-daemon-ccg6m" (UID: "768a1bdd-30a9-4097-8a09-c4b08dfac2d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:30.040140 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:30.040157 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:30.040169 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgwsr for pod openshift-network-diagnostics/network-check-target-pk245: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:30.040527 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:30.040203 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr podName:3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad nodeName:}" failed. No retries permitted until 2026-07-29 10:28:32.040192255 +0000 UTC m=+6.130085216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgwsr" (UniqueName: "kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr") pod "network-check-target-pk245" (UID: "3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:30.359159 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:30.359001 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:23:28 +0000 UTC" deadline="2028-03-21 12:23:47.781705535 +0000 UTC" Jul 29 10:28:30.359159 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:30.359059 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14425h55m17.422651216s" Jul 29 10:28:30.468459 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:30.468423 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:30.468692 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:30.468621 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:30.493681 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:30.493066 2580 generic.go:356] "Generic (PLEG): container finished" podID="f8987dd7b1ac136e31414dbb5a48a765" containerID="da8222eec8aa28cdd7476fd6a437d9a12ae7aaf4f189e34e49321ba22e454209" exitCode=0 Jul 29 10:28:30.493681 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:30.493175 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" event={"ID":"f8987dd7b1ac136e31414dbb5a48a765","Type":"ContainerDied","Data":"da8222eec8aa28cdd7476fd6a437d9a12ae7aaf4f189e34e49321ba22e454209"} Jul 29 10:28:31.454920 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:31.454887 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:31.455362 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:31.455106 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:31.455565 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:31.455506 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:31.455682 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:31.455658 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:31.500468 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:31.500395 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" event={"ID":"f8987dd7b1ac136e31414dbb5a48a765","Type":"ContainerStarted","Data":"3a5f6f6d316caecaa49a91004e22ea989fb36f224c6d68084fe661a58b1ebca9"} Jul 29 10:28:31.961805 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:31.961200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:31.961805 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:31.961391 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:31.961805 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:31.961453 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret podName:27fd048a-2b59-4ba1-9ae4-a46f2f8a622a nodeName:}" failed. No retries permitted until 2026-07-29 10:28:35.961434669 +0000 UTC m=+10.051327630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret") pod "global-pull-secret-syncer-spzhb" (UID: "27fd048a-2b59-4ba1-9ae4-a46f2f8a622a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:32.061552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:32.061647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:32.061798 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:32.061818 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:32.061831 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgwsr for pod openshift-network-diagnostics/network-check-target-pk245: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:32.061907 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr podName:3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad nodeName:}" failed. No retries permitted until 2026-07-29 10:28:36.061888197 +0000 UTC m=+10.151781169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgwsr" (UniqueName: "kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr") pod "network-check-target-pk245" (UID: "3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:32.062338 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:32.062487 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:32.062392 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs podName:768a1bdd-30a9-4097-8a09-c4b08dfac2d0 nodeName:}" failed. No retries permitted until 2026-07-29 10:28:36.062376643 +0000 UTC m=+10.152269601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs") pod "network-metrics-daemon-ccg6m" (UID: "768a1bdd-30a9-4097-8a09-c4b08dfac2d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:32.459512 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:32.459219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:32.459512 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:32.459340 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:33.455416 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:33.454631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:33.455416 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:33.454767 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:33.455416 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:33.455276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:33.455416 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:33.455371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:34.454454 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:34.454416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:34.454929 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:34.454555 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:35.454651 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:35.454612 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:35.454651 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:35.454645 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:35.455165 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:35.454809 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:35.455165 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:35.454911 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:36.002249 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:36.001629 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:36.002249 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.001816 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:36.002249 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.001906 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret podName:27fd048a-2b59-4ba1-9ae4-a46f2f8a622a nodeName:}" failed. No retries permitted until 2026-07-29 10:28:44.001887302 +0000 UTC m=+18.091780268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret") pod "global-pull-secret-syncer-spzhb" (UID: "27fd048a-2b59-4ba1-9ae4-a46f2f8a622a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:36.102639 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:36.102564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:36.102639 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:36.102612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:36.102906 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.102711 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:36.102906 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.102718 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:28:36.102906 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.102743 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:28:36.102906 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.102756 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgwsr for pod openshift-network-diagnostics/network-check-target-pk245: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:36.102906 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.102761 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs podName:768a1bdd-30a9-4097-8a09-c4b08dfac2d0 nodeName:}" failed. No retries permitted until 2026-07-29 10:28:44.102748107 +0000 UTC m=+18.192641062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs") pod "network-metrics-daemon-ccg6m" (UID: "768a1bdd-30a9-4097-8a09-c4b08dfac2d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:36.102906 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.102806 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr podName:3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad nodeName:}" failed. No retries permitted until 2026-07-29 10:28:44.102790359 +0000 UTC m=+18.192683329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgwsr" (UniqueName: "kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr") pod "network-check-target-pk245" (UID: "3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:36.460282 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:36.460207 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:36.460753 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:36.460690 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:37.454881 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:37.454620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:37.454881 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:37.454651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:37.454881 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:37.454775 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:37.455134 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:37.454912 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:38.454979 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:38.454943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:38.455408 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:38.455075 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:39.455107 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:39.455077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:39.455545 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:39.455077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:39.455545 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:39.455200 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:39.455545 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:39.455258 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:40.454482 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:40.454443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:40.454623 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:40.454552 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:41.454610 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:41.454566 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:41.455123 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:41.454693 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:41.455123 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:41.454749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:41.455123 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:41.454837 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:42.454705 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:42.454670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:42.455156 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:42.454809 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:43.454447 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:43.454408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:43.454447 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:43.454434 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:43.454790 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:43.454527 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:43.454790 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:43.454673 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:44.063521 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:44.063474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:44.063708 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.063589 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:44.063708 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.063649 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret podName:27fd048a-2b59-4ba1-9ae4-a46f2f8a622a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:00.06362884 +0000 UTC m=+34.153521886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret") pod "global-pull-secret-syncer-spzhb" (UID: "27fd048a-2b59-4ba1-9ae4-a46f2f8a622a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:28:44.164754 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:44.164712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:44.164954 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:44.164785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:44.164954 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.164844 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:28:44.164954 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.164894 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:28:44.164954 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.164909 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgwsr for pod openshift-network-diagnostics/network-check-target-pk245: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:44.164954 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.164922 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:44.165205 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.164976 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr podName:3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad nodeName:}" failed. No retries permitted until 2026-07-29 10:29:00.164956772 +0000 UTC m=+34.254849752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgwsr" (UniqueName: "kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr") pod "network-check-target-pk245" (UID: "3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:28:44.165205 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.164997 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs podName:768a1bdd-30a9-4097-8a09-c4b08dfac2d0 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:00.164987583 +0000 UTC m=+34.254880538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs") pod "network-metrics-daemon-ccg6m" (UID: "768a1bdd-30a9-4097-8a09-c4b08dfac2d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:28:44.455197 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:44.455116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:44.455650 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:44.455245 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:45.454729 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:45.454690 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:45.454729 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:45.454718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:45.454995 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:45.454813 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:45.454995 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:45.454952 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:46.455324 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:46.455290 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:46.455811 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:46.455387 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:47.454371 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:47.454341 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:47.454557 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:47.454338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:47.454557 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:47.454455 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:47.454557 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:47.454543 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:48.454832 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.454497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:48.455580 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:48.454946 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:48.533526 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.533490 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-slrcg" event={"ID":"bdd860fb-acf4-424b-92e2-518fba7c751b","Type":"ContainerStarted","Data":"29308443a1f263b783a0749b419a079de8fa923dfad2b6fbe083ab3dd0350fdf"} Jul 29 10:28:48.535252 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.535212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64p6z" event={"ID":"022b842d-1c95-4199-8b1a-39a5ab456151","Type":"ContainerStarted","Data":"a920bbf0d034300d37903feb958262a454c41d613f3b957a34c524113c05736d"} Jul 29 10:28:48.536787 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.536763 2580 generic.go:356] "Generic (PLEG): container finished" podID="13c4ca7d-1f16-4cbb-a2ad-a1732995aea9" containerID="742854f1a8d7676bad8ff37935f444e00610a4cd040c5bd21e012cb0cf4c8837" exitCode=0 Jul 29 10:28:48.536893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.536845 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerDied","Data":"742854f1a8d7676bad8ff37935f444e00610a4cd040c5bd21e012cb0cf4c8837"} Jul 29 10:28:48.538318 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.538292 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j9rws" event={"ID":"b950870a-55fa-47c1-bc20-91cfaee138f4","Type":"ContainerStarted","Data":"addb584e26cba5e74a68056188f8caecb8d7461fcc6d17e7116a29f43a87f61a"} Jul 29 10:28:48.541994 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.541971 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"b188f9c3042a3ba1c715f42fc8da6060f967a929255efc2b391e2f2b578e7938"} Jul 29 10:28:48.542092 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.542057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"42049aa93472bc82d94a2e7821db2e0a1fc9e9b3368a1113fa83906d214a2225"} Jul 29 10:28:48.542150 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.542106 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"2aac2bb0982439ce7bce7cb6dcae80faf804fe9ad8b6d70207e0f457c6fa8cea"} Jul 29 10:28:48.542206 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.542147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"480ddcff6b1c47b3426c677ce11bd35d3db6deb26ad1c3625debe04f447b4ca7"} Jul 29 10:28:48.542206 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.542195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"904bce9a8d48446d9a71df9091ef7ebe327b0160164793af34b3a3a448f2a2c1"} Jul 29 10:28:48.542301 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.542245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"1ae70447c9650bb08d59d394a598df1faaa99651dc03c5faffbaac82f10f02ff"} Jul 29 10:28:48.543516 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.543490 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" event={"ID":"5c59a58a-6634-46b6-b5e9-feca01e03035","Type":"ContainerStarted","Data":"37159d7b192a314f7f4ed6cdc79876693f7cf4cc75a35cdfd756e5d2e9248b8b"} Jul 29 10:28:48.545169 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.544992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vqwz" event={"ID":"2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f","Type":"ContainerStarted","Data":"2fdaf374ee353dd52ffd3a4f404d6c439b9898fb534e31ddd1333b48080b984b"} Jul 29 10:28:48.546745 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.546696 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" event={"ID":"ad705693-2b4e-4e21-bbf3-55ce0773ddc2","Type":"ContainerStarted","Data":"ab8ea9357943c68a6771d5bddf622007f67f67e941baf247fb3be80072472a4e"} Jul 29 10:28:48.550824 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.550776 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-slrcg" podStartSLOduration=11.905964479 podStartE2EDuration="22.550761225s" totalImagesPullingTime="10.644796746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:48.550556716 +0000 UTC m=+22.640449694" watchObservedRunningTime="2026-07-29 10:28:48.550761225 +0000 UTC m=+22.640654206" Jul 29 10:28:48.551656 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.551621 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-188.ec2.internal" podStartSLOduration=21.551614797 podStartE2EDuration="21.551614797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:31.520297808 +0000 UTC m=+5.610190786" watchObservedRunningTime="2026-07-29 10:28:48.551614797 +0000 UTC m=+22.641507775" Jul 29 10:28:48.590687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.590583 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j9rws" podStartSLOduration=4.124595333 podStartE2EDuration="22.590563579s" totalImagesPullingTime="18.465968246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:48.590551198 +0000 UTC m=+22.680444176" watchObservedRunningTime="2026-07-29 10:28:48.590563579 +0000 UTC m=+22.680456557" Jul 29 10:28:48.609499 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.609446 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6vqwz" podStartSLOduration=4.149778995 podStartE2EDuration="22.609427306s" totalImagesPullingTime="18.459648311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:48.609350017 +0000 UTC m=+22.699242994" watchObservedRunningTime="2026-07-29 10:28:48.609427306 +0000 UTC m=+22.699320288" Jul 29 10:28:48.628100 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.628060 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pcvqf" podStartSLOduration=4.164908127 podStartE2EDuration="22.628046681s" totalImagesPullingTime="18.463138554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:48.627829261 +0000 UTC m=+22.717722235" watchObservedRunningTime="2026-07-29 10:28:48.628046681 +0000 UTC m=+22.717939659" Jul 29 10:28:48.646912 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:48.646844 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-64p6z" podStartSLOduration=4.117747972 podStartE2EDuration="22.646826665s" totalImagesPullingTime="18.529078693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:48.646029255 +0000 UTC m=+22.735922228" watchObservedRunningTime="2026-07-29 10:28:48.646826665 +0000 UTC m=+22.736719626" Jul 29 10:28:49.275598 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.275556 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 10:28:49.454576 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.454501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:49.454576 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.454543 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:49.454818 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:49.454633 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:49.454818 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:49.454759 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:49.498849 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.498755 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T10:28:49.275581498Z","UUID":"6e2890f3-7f5b-4c2e-9035-aa274bde342f","Handler":null,"Name":"","Endpoint":""} Jul 29 10:28:49.500483 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.500464 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 10:28:49.500592 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.500499 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 10:28:49.550671 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.550641 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hjkqh" event={"ID":"aed36b38-366f-4d21-9ce8-41a52305d78a","Type":"ContainerStarted","Data":"14d68a3cc8f03e94a2647ea35a34607c4e19f96196b3234625b1368e9fb0d3fc"} Jul 29 10:28:49.552870 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.552832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" event={"ID":"5c59a58a-6634-46b6-b5e9-feca01e03035","Type":"ContainerStarted","Data":"a4827cc4e034a692b76d6b93da635da323f70e86ad0f442d94812031349331ce"} Jul 29 10:28:49.569072 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:49.569029 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hjkqh" podStartSLOduration=5.105156314 podStartE2EDuration="23.569015183s" totalImagesPullingTime="18.463858869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:49.568408307 +0000 UTC m=+23.658301287" watchObservedRunningTime="2026-07-29 10:28:49.569015183 +0000 UTC m=+23.658908159" Jul 29 10:28:50.454665 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:50.454633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:50.455070 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:50.454761 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:51.454982 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:51.454726 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:51.455146 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:51.454754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:51.455146 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:51.455105 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:51.455478 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:51.455156 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:51.565214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:51.565181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"3db4c5bc9f21b3e05e8872bfddddb0d637301d3924738b596286c9141e72305d"} Jul 29 10:28:51.567613 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:51.567580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" event={"ID":"5c59a58a-6634-46b6-b5e9-feca01e03035","Type":"ContainerStarted","Data":"ca966a1e989cc3fe3c5eccbdb9fe78d9896af82be8af2b35ae0856d9d98979bb"} Jul 29 10:28:51.590833 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:51.590784 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46tng" podStartSLOduration=4.650384263 podStartE2EDuration="25.59076905s" totalImagesPullingTime="20.940384787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:51.589099021 +0000 UTC m=+25.678991999" watchObservedRunningTime="2026-07-29 10:28:51.59076905 +0000 UTC m=+25.680662027" Jul 29 10:28:51.780079 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:51.780051 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:51.780651 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:51.780629 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:52.454231 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:52.454199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:52.454459 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:52.454321 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:53.455345 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.455162 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:53.456101 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.455166 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:53.456101 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:53.455417 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:53.456101 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:53.455504 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:53.574125 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.574096 2580 generic.go:356] "Generic (PLEG): container finished" podID="13c4ca7d-1f16-4cbb-a2ad-a1732995aea9" containerID="14abbbbc97b66ca2b44d882a6c2cfc6b6a71d866e9a6235a42c05afe7071a444" exitCode=0 Jul 29 10:28:53.574291 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.574138 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerDied","Data":"14abbbbc97b66ca2b44d882a6c2cfc6b6a71d866e9a6235a42c05afe7071a444"} Jul 29 10:28:53.577835 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.577814 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" event={"ID":"6787dcaa-5c70-413b-9414-acbc2483d422","Type":"ContainerStarted","Data":"c26a37e0ec3553639b647c9dde27bccc5a61e74c552050110fb79f38be93dbf5"} Jul 29 10:28:53.578077 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.578055 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:53.578172 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.578131 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:53.578229 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.578181 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:53.594123 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.594092 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:53.594258 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.594195 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:28:53.627652 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:53.627610 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" podStartSLOduration=9.104760457 podStartE2EDuration="27.627593643s" totalImagesPullingTime="18.522833186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:53.625626217 +0000 UTC m=+27.715519193" watchObservedRunningTime="2026-07-29 10:28:53.627593643 +0000 UTC m=+27.717486620" Jul 29 10:28:54.457215 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:54.457187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:54.457601 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:54.457281 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:54.873667 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:54.873630 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-spzhb"] Jul 29 10:28:54.873914 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:54.873755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:54.873914 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:54.873843 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:54.874508 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:54.874481 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ccg6m"] Jul 29 10:28:54.874615 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:54.874601 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:54.874723 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:54.874703 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:54.875260 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:54.875201 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pk245"] Jul 29 10:28:54.875347 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:54.875289 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:54.875475 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:54.875376 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:55.584214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:55.584175 2580 generic.go:356] "Generic (PLEG): container finished" podID="13c4ca7d-1f16-4cbb-a2ad-a1732995aea9" containerID="66eb9b999ba25174e71f24993e478eea39279b4ce859a8d2ee63a1b086c751c1" exitCode=0 Jul 29 10:28:55.584678 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:55.584255 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerDied","Data":"66eb9b999ba25174e71f24993e478eea39279b4ce859a8d2ee63a1b086c751c1"} Jul 29 10:28:56.455322 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:56.455288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:56.455486 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:56.455386 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:56.455486 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:56.455461 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:56.455556 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:56.455552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:56.455614 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:56.455580 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:56.455650 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:56.455633 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:57.592236 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:57.591973 2580 generic.go:356] "Generic (PLEG): container finished" podID="13c4ca7d-1f16-4cbb-a2ad-a1732995aea9" containerID="3ab007d1f723322bbebbd29baefef7633b166cca45d737644cb594ca1fb62b62" exitCode=0 Jul 29 10:28:57.592602 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:57.592023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerDied","Data":"3ab007d1f723322bbebbd29baefef7633b166cca45d737644cb594ca1fb62b62"} Jul 29 10:28:58.454518 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:58.454482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:28:58.454734 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:58.454482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:28:58.454734 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:58.454618 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:28:58.454734 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:58.454612 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:28:58.454734 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:58.454720 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:28:58.455013 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:28:58.454817 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:28:58.510966 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:58.510922 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:28:58.511137 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:58.511052 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 10:28:58.511478 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:28:58.511399 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-slrcg" Jul 29 10:29:00.075234 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.075201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:29:00.075942 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.075334 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:00.075942 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.075407 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret podName:27fd048a-2b59-4ba1-9ae4-a46f2f8a622a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:32.075387916 +0000 UTC m=+66.165280884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret") pod "global-pull-secret-syncer-spzhb" (UID: "27fd048a-2b59-4ba1-9ae4-a46f2f8a622a") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:29:00.176737 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.176700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:29:00.176936 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.176759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:29:00.176936 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.176871 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:00.176936 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.176876 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:29:00.176936 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.176900 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:29:00.176936 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.176910 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgwsr for pod openshift-network-diagnostics/network-check-target-pk245: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:00.176936 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.176936 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs podName:768a1bdd-30a9-4097-8a09-c4b08dfac2d0 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:32.176917011 +0000 UTC m=+66.266809981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs") pod "network-metrics-daemon-ccg6m" (UID: "768a1bdd-30a9-4097-8a09-c4b08dfac2d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:29:00.177151 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.176954 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr podName:3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad nodeName:}" failed. No retries permitted until 2026-07-29 10:29:32.176944861 +0000 UTC m=+66.266837816 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgwsr" (UniqueName: "kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr") pod "network-check-target-pk245" (UID: "3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:29:00.458169 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.458144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:29:00.458338 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.458245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:29:00.458338 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.458250 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccg6m" podUID="768a1bdd-30a9-4097-8a09-c4b08dfac2d0" Jul 29 10:29:00.458338 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.458269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:29:00.458338 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.458328 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pk245" podUID="3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad" Jul 29 10:29:00.458512 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.458400 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spzhb" podUID="27fd048a-2b59-4ba1-9ae4-a46f2f8a622a" Jul 29 10:29:00.735074 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.734996 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-188.ec2.internal" event="NodeReady" Jul 29 10:29:00.735229 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.735163 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 10:29:00.789952 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.789923 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xlgwk"] Jul 29 10:29:00.795452 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.795429 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d4w6d"] Jul 29 10:29:00.795593 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.795554 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.800127 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.800102 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 10:29:00.800221 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.800183 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rxxsv\"" Jul 29 10:29:00.800389 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.800370 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 10:29:00.800512 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.800494 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:00.803721 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.803699 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 10:29:00.803810 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.803769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zl4tt\"" Jul 29 10:29:00.803894 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.803838 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 10:29:00.803951 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.803937 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 10:29:00.808989 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.808969 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4w6d"] Jul 29 10:29:00.812082 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.811675 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlgwk"] Jul 29 10:29:00.881772 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.881747 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.881939 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.881890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c683f5cd-2600-4422-bbb2-5ece4d87838a-config-volume\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.881939 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.881916 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmjq\" (UniqueName: \"kubernetes.io/projected/c683f5cd-2600-4422-bbb2-5ece4d87838a-kube-api-access-ljmjq\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.882026 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.881943 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c683f5cd-2600-4422-bbb2-5ece4d87838a-tmp-dir\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.983145 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c683f5cd-2600-4422-bbb2-5ece4d87838a-config-volume\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.983145 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmjq\" (UniqueName: \"kubernetes.io/projected/c683f5cd-2600-4422-bbb2-5ece4d87838a-kube-api-access-ljmjq\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.983347 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fa68c7e-213d-4c6f-8cb4-afdb53a505f9-cert\") pod \"ingress-canary-d4w6d\" (UID: \"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9\") " pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:00.983347 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983312 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c683f5cd-2600-4422-bbb2-5ece4d87838a-tmp-dir\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.983442 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.983504 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7fzg\" (UniqueName: \"kubernetes.io/projected/5fa68c7e-213d-4c6f-8cb4-afdb53a505f9-kube-api-access-k7fzg\") pod \"ingress-canary-d4w6d\" (UID: \"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9\") " pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:00.983540 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.983499 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:00.983580 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:00.983548 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls podName:c683f5cd-2600-4422-bbb2-5ece4d87838a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:01.483534164 +0000 UTC m=+35.573427135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls") pod "dns-default-xlgwk" (UID: "c683f5cd-2600-4422-bbb2-5ece4d87838a") : secret "dns-default-metrics-tls" not found Jul 29 10:29:00.983621 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983581 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c683f5cd-2600-4422-bbb2-5ece4d87838a-tmp-dir\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.983802 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.983778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c683f5cd-2600-4422-bbb2-5ece4d87838a-config-volume\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:00.994928 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:00.994851 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmjq\" (UniqueName: \"kubernetes.io/projected/c683f5cd-2600-4422-bbb2-5ece4d87838a-kube-api-access-ljmjq\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:01.084123 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:01.084088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7fzg\" (UniqueName: \"kubernetes.io/projected/5fa68c7e-213d-4c6f-8cb4-afdb53a505f9-kube-api-access-k7fzg\") pod \"ingress-canary-d4w6d\" (UID: \"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9\") " pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:01.084734 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:01.084292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fa68c7e-213d-4c6f-8cb4-afdb53a505f9-cert\") pod \"ingress-canary-d4w6d\" (UID: \"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9\") " pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:01.087140 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:01.087116 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fa68c7e-213d-4c6f-8cb4-afdb53a505f9-cert\") pod \"ingress-canary-d4w6d\" (UID: \"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9\") " pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:01.094073 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:01.094049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7fzg\" (UniqueName: \"kubernetes.io/projected/5fa68c7e-213d-4c6f-8cb4-afdb53a505f9-kube-api-access-k7fzg\") pod \"ingress-canary-d4w6d\" (UID: \"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9\") " pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:01.114956 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:01.114931 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4w6d" Jul 29 10:29:01.486749 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:01.486715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:01.486948 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:01.486854 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:01.486948 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:01.486940 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls podName:c683f5cd-2600-4422-bbb2-5ece4d87838a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:02.486919896 +0000 UTC m=+36.576812865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls") pod "dns-default-xlgwk" (UID: "c683f5cd-2600-4422-bbb2-5ece4d87838a") : secret "dns-default-metrics-tls" not found Jul 29 10:29:01.881684 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:01.881446 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4w6d"] Jul 29 10:29:01.913708 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:01.913680 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa68c7e_213d_4c6f_8cb4_afdb53a505f9.slice/crio-d83ff972008ef45e35e429654eedf92e7bc61053ffcb392dcd11f7e13db1c425 WatchSource:0}: Error finding container d83ff972008ef45e35e429654eedf92e7bc61053ffcb392dcd11f7e13db1c425: Status 404 returned error can't find the container with id d83ff972008ef45e35e429654eedf92e7bc61053ffcb392dcd11f7e13db1c425 Jul 29 10:29:02.454740 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.454702 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:29:02.455211 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.454702 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:29:02.455211 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.454704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:29:02.459332 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.459309 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 10:29:02.459332 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.459315 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wmbjw\"" Jul 29 10:29:02.460580 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.460566 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:29:02.460646 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.460612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:29:02.460709 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.460619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 10:29:02.460750 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.460732 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l8nkz\"" Jul 29 10:29:02.495070 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.495043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:02.495203 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:02.495185 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:02.495264 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:02.495253 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls podName:c683f5cd-2600-4422-bbb2-5ece4d87838a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:04.495236503 +0000 UTC m=+38.585129478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls") pod "dns-default-xlgwk" (UID: "c683f5cd-2600-4422-bbb2-5ece4d87838a") : secret "dns-default-metrics-tls" not found Jul 29 10:29:02.608576 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.608542 2580 generic.go:356] "Generic (PLEG): container finished" podID="13c4ca7d-1f16-4cbb-a2ad-a1732995aea9" containerID="c9ba969d36f60031ffca1c6124a99280949d2e342772261f920165c50bf1a15e" exitCode=0 Jul 29 10:29:02.608791 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.608600 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerDied","Data":"c9ba969d36f60031ffca1c6124a99280949d2e342772261f920165c50bf1a15e"} Jul 29 10:29:02.609796 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:02.609776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4w6d" event={"ID":"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9","Type":"ContainerStarted","Data":"d83ff972008ef45e35e429654eedf92e7bc61053ffcb392dcd11f7e13db1c425"} Jul 29 10:29:03.615791 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:03.615762 2580 generic.go:356] "Generic (PLEG): container finished" podID="13c4ca7d-1f16-4cbb-a2ad-a1732995aea9" containerID="c175a4bdcad2d69f6dc48e4675c7fd9e1704aa0fb7ef1b4c294056c695d96fab" exitCode=0 Jul 29 10:29:03.616201 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:03.615801 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerDied","Data":"c175a4bdcad2d69f6dc48e4675c7fd9e1704aa0fb7ef1b4c294056c695d96fab"} Jul 29 10:29:04.514601 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:04.514473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:04.514678 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:04.514603 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:04.514678 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:04.514654 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls podName:c683f5cd-2600-4422-bbb2-5ece4d87838a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:08.514640152 +0000 UTC m=+42.604533127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls") pod "dns-default-xlgwk" (UID: "c683f5cd-2600-4422-bbb2-5ece4d87838a") : secret "dns-default-metrics-tls" not found Jul 29 10:29:04.620920 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:04.620892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" event={"ID":"13c4ca7d-1f16-4cbb-a2ad-a1732995aea9","Type":"ContainerStarted","Data":"8f3331077d1ca6660d4d28a49f7d3c7a7eff456438a094e850b96cb5a5d5700e"} Jul 29 10:29:04.646408 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:04.646333 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5ct4t" podStartSLOduration=8.391569207 podStartE2EDuration="38.646317702s" totalImagesPullingTime="30.254748495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:04.645752633 +0000 UTC m=+38.735645609" watchObservedRunningTime="2026-07-29 10:29:04.646317702 +0000 UTC m=+38.736210657" Jul 29 10:29:05.625642 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:05.624686 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4w6d" event={"ID":"5fa68c7e-213d-4c6f-8cb4-afdb53a505f9","Type":"ContainerStarted","Data":"9e662e01d4d541b7f1362b8f8ef8743133eb5875cf5a85cbcfe67f49c3f7809d"} Jul 29 10:29:05.643825 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:05.643783 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d4w6d" podStartSLOduration=2.790744065 podStartE2EDuration="5.643770313s" totalImagesPullingTime="2.853026248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:05.642885717 +0000 UTC m=+39.732778695" watchObservedRunningTime="2026-07-29 10:29:05.643770313 +0000 UTC m=+39.733663287" Jul 29 10:29:06.778778 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.778746 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z"] Jul 29 10:29:06.798802 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.798776 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7"] Jul 29 10:29:06.798943 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.798914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:06.801845 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.801825 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 10:29:06.803560 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.803542 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 10:29:06.805449 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.805177 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 10:29:06.805449 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.805256 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r2bcz\"" Jul 29 10:29:06.805546 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.805522 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 10:29:06.818934 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.818912 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z"] Jul 29 10:29:06.818999 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.818939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7"] Jul 29 10:29:06.818999 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.818997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" Jul 29 10:29:06.821988 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.821970 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vv987\"" Jul 29 10:29:06.872310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.872280 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk"] Jul 29 10:29:06.894974 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.894952 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj"] Jul 29 10:29:06.895080 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.895071 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:06.898164 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.898142 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 10:29:06.898285 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.898142 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 10:29:06.898285 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.898216 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:29:06.898285 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.898236 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wfrk8\"" Jul 29 10:29:06.919076 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.919042 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk"] Jul 29 10:29:06.919212 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.919091 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj"] Jul 29 10:29:06.919212 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.919190 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:06.922392 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.922367 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 10:29:06.922530 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.922376 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 10:29:06.922530 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.922388 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wh72k\"" Jul 29 10:29:06.933505 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.933473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:06.933625 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.933606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zbz7\" (UniqueName: \"kubernetes.io/projected/20303846-8a86-4ecd-a03d-9f1104dd04d7-kube-api-access-4zbz7\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:06.933677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.933659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgnkw\" (UniqueName: \"kubernetes.io/projected/2aec7501-711c-4885-8a00-ac24d814018f-kube-api-access-pgnkw\") pod \"network-check-source-7d88cb55d8-2pzw7\" (UID: \"2aec7501-711c-4885-8a00-ac24d814018f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" Jul 29 10:29:06.933713 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.933694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20303846-8a86-4ecd-a03d-9f1104dd04d7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:06.976170 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.976138 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-565pv"] Jul 29 10:29:06.998974 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.998950 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6898c89c69-xzjv2"] Jul 29 10:29:06.999120 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:06.999091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.002155 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.002138 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 10:29:07.002155 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.002149 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 10:29:07.002326 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.002187 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 10:29:07.002326 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.002288 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6mvxt\"" Jul 29 10:29:07.002405 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.002358 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 10:29:07.009466 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.009445 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 10:29:07.019064 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.019046 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-655f9bb4bd-7mjd2"] Jul 29 10:29:07.019178 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.019161 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.022385 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.022364 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 10:29:07.022385 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.022367 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 10:29:07.022726 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.022477 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 10:29:07.022726 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.022521 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 10:29:07.022726 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.022612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 10:29:07.022726 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.022645 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7p4jk\"" Jul 29 10:29:07.022937 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.022765 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 10:29:07.034138 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:07.034242 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8sgt\" (UniqueName: \"kubernetes.io/projected/1e66bad5-b1c4-4cc2-98ed-e92812fed571-kube-api-access-n8sgt\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:07.034242 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:07.034242 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zbz7\" (UniqueName: \"kubernetes.io/projected/20303846-8a86-4ecd-a03d-9f1104dd04d7-kube-api-access-4zbz7\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:07.034242 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:07.034459 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnkw\" (UniqueName: \"kubernetes.io/projected/2aec7501-711c-4885-8a00-ac24d814018f-kube-api-access-pgnkw\") pod \"network-check-source-7d88cb55d8-2pzw7\" (UID: \"2aec7501-711c-4885-8a00-ac24d814018f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" Jul 29 10:29:07.034459 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20303846-8a86-4ecd-a03d-9f1104dd04d7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:07.034551 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.034455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:07.034620 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.034602 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:07.034686 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.034664 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls podName:20303846-8a86-4ecd-a03d-9f1104dd04d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:07.534649399 +0000 UTC m=+41.624542368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hp29z" (UID: "20303846-8a86-4ecd-a03d-9f1104dd04d7") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:07.035027 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.035010 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20303846-8a86-4ecd-a03d-9f1104dd04d7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:07.044817 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.044789 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zbz7\" (UniqueName: \"kubernetes.io/projected/20303846-8a86-4ecd-a03d-9f1104dd04d7-kube-api-access-4zbz7\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:07.044982 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.044951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnkw\" (UniqueName: \"kubernetes.io/projected/2aec7501-711c-4885-8a00-ac24d814018f-kube-api-access-pgnkw\") pod \"network-check-source-7d88cb55d8-2pzw7\" (UID: \"2aec7501-711c-4885-8a00-ac24d814018f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" Jul 29 10:29:07.045183 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.045166 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-565pv"] Jul 29 10:29:07.045279 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.045194 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6898c89c69-xzjv2"] Jul 29 10:29:07.045279 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.045220 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655f9bb4bd-7mjd2"] Jul 29 10:29:07.045387 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.045282 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.048129 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.048102 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 10:29:07.048519 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.048497 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 10:29:07.048611 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.048529 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 10:29:07.048893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.048877 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6wkgt\"" Jul 29 10:29:07.054490 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.054470 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 10:29:07.127293 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.127256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" Jul 29 10:29:07.135778 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.135751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:07.135933 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.135789 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwq5\" (UniqueName: \"kubernetes.io/projected/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-kube-api-access-nbwq5\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.135933 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.135820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-certificates\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.135933 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.135837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-bound-sa-token\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.135933 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.135852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms44t\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-kube-api-access-ms44t\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.135933 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.135916 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 10:29:07.135933 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.135918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.135954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bfffe02-f038-40e3-9087-d10b8b2ab39d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.135991 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls podName:1e66bad5-b1c4-4cc2-98ed-e92812fed571 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:07.635974715 +0000 UTC m=+41.725867670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls") pod "cluster-samples-operator-6748489656-74llk" (UID: "1e66bad5-b1c4-4cc2-98ed-e92812fed571") : secret "samples-operator-tls" not found Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136053 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5bfffe02-f038-40e3-9087-d10b8b2ab39d-snapshots\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvsd5\" (UniqueName: \"kubernetes.io/projected/5bfffe02-f038-40e3-9087-d10b8b2ab39d-kube-api-access-wvsd5\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136097 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-default-certificate\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bfffe02-f038-40e3-9087-d10b8b2ab39d-service-ca-bundle\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136150 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bfffe02-f038-40e3-9087-d10b8b2ab39d-tmp\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-image-registry-private-configuration\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.136214 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8sgt\" (UniqueName: \"kubernetes.io/projected/1e66bad5-b1c4-4cc2-98ed-e92812fed571-kube-api-access-n8sgt\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136290 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-trusted-ca\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bfffe02-f038-40e3-9087-d10b8b2ab39d-serving-cert\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-stats-auth\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.136402 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136412 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.136455 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert podName:db8dc379-af2d-4150-b9c2-2e4cd1152d7d nodeName:}" failed. No retries permitted until 2026-07-29 10:29:07.636439961 +0000 UTC m=+41.726332941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d6jzj" (UID: "db8dc379-af2d-4150-b9c2-2e4cd1152d7d") : secret "networking-console-plugin-cert" not found Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-installation-pull-secrets\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83e869ec-a2c3-4378-adb7-98d16efe23d3-ca-trust-extracted\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.136653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.136631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:07.144394 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.144371 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8sgt\" (UniqueName: \"kubernetes.io/projected/1e66bad5-b1c4-4cc2-98ed-e92812fed571-kube-api-access-n8sgt\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwq5\" (UniqueName: \"kubernetes.io/projected/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-kube-api-access-nbwq5\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-certificates\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-bound-sa-token\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms44t\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-kube-api-access-ms44t\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bfffe02-f038-40e3-9087-d10b8b2ab39d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5bfffe02-f038-40e3-9087-d10b8b2ab39d-snapshots\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvsd5\" (UniqueName: \"kubernetes.io/projected/5bfffe02-f038-40e3-9087-d10b8b2ab39d-kube-api-access-wvsd5\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-default-certificate\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bfffe02-f038-40e3-9087-d10b8b2ab39d-service-ca-bundle\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bfffe02-f038-40e3-9087-d10b8b2ab39d-tmp\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-image-registry-private-configuration\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238010 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.237980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.238674 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-trusted-ca\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238674 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bfffe02-f038-40e3-9087-d10b8b2ab39d-serving-cert\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.238775 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-stats-auth\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.238775 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.238775 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238775 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-installation-pull-secrets\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238991 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83e869ec-a2c3-4378-adb7-98d16efe23d3-ca-trust-extracted\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.238991 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.238956 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-certificates\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.240219 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.239234 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83e869ec-a2c3-4378-adb7-98d16efe23d3-ca-trust-extracted\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.240219 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.239323 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bfffe02-f038-40e3-9087-d10b8b2ab39d-service-ca-bundle\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.240219 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.239509 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:07.240219 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.239572 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:07.739553255 +0000 UTC m=+41.829446232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : secret "router-metrics-certs-default" not found Jul 29 10:29:07.240219 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.239808 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5bfffe02-f038-40e3-9087-d10b8b2ab39d-snapshots\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.240219 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.239826 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:07.73980913 +0000 UTC m=+41.829702105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:07.241327 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.241172 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:29:07.241327 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.241250 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655f9bb4bd-7mjd2: secret "image-registry-tls" not found Jul 29 10:29:07.241327 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.241303 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls podName:83e869ec-a2c3-4378-adb7-98d16efe23d3 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:07.741279358 +0000 UTC m=+41.831172313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls") pod "image-registry-655f9bb4bd-7mjd2" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3") : secret "image-registry-tls" not found Jul 29 10:29:07.241542 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.241446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bfffe02-f038-40e3-9087-d10b8b2ab39d-tmp\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.241602 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.241582 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-trusted-ca\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.244900 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.242959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-installation-pull-secrets\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.244900 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.243085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-image-registry-private-configuration\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.244900 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.243167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-stats-auth\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.244900 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.243179 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bfffe02-f038-40e3-9087-d10b8b2ab39d-serving-cert\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.244900 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.244293 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bfffe02-f038-40e3-9087-d10b8b2ab39d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.244900 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.244822 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-default-certificate\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.248337 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.248311 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms44t\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-kube-api-access-ms44t\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.248642 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.248624 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwq5\" (UniqueName: \"kubernetes.io/projected/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-kube-api-access-nbwq5\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.248753 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.248735 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvsd5\" (UniqueName: \"kubernetes.io/projected/5bfffe02-f038-40e3-9087-d10b8b2ab39d-kube-api-access-wvsd5\") pod \"insights-operator-5885fdb759-565pv\" (UID: \"5bfffe02-f038-40e3-9087-d10b8b2ab39d\") " pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.249348 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.249327 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-bound-sa-token\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.273256 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.273228 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7"] Jul 29 10:29:07.276603 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:07.276571 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aec7501_711c_4885_8a00_ac24d814018f.slice/crio-c40de08adc40d9ac4a7496e06a4323304ca613b4a7debed081a8f7ac84161f08 WatchSource:0}: Error finding container c40de08adc40d9ac4a7496e06a4323304ca613b4a7debed081a8f7ac84161f08: Status 404 returned error can't find the container with id c40de08adc40d9ac4a7496e06a4323304ca613b4a7debed081a8f7ac84161f08 Jul 29 10:29:07.308419 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.308345 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-565pv" Jul 29 10:29:07.458553 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.458522 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-565pv"] Jul 29 10:29:07.461411 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:07.461386 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfffe02_f038_40e3_9087_d10b8b2ab39d.slice/crio-e437c4c30abc8836f3b2a4c9a86bb8a040d9c7294b455d9646ed98921277d1c1 WatchSource:0}: Error finding container e437c4c30abc8836f3b2a4c9a86bb8a040d9c7294b455d9646ed98921277d1c1: Status 404 returned error can't find the container with id e437c4c30abc8836f3b2a4c9a86bb8a040d9c7294b455d9646ed98921277d1c1 Jul 29 10:29:07.541680 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.541648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:07.541836 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.541801 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:07.541927 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.541886 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls podName:20303846-8a86-4ecd-a03d-9f1104dd04d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:08.541850799 +0000 UTC m=+42.631743784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hp29z" (UID: "20303846-8a86-4ecd-a03d-9f1104dd04d7") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:07.630644 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.630551 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-565pv" event={"ID":"5bfffe02-f038-40e3-9087-d10b8b2ab39d","Type":"ContainerStarted","Data":"e437c4c30abc8836f3b2a4c9a86bb8a040d9c7294b455d9646ed98921277d1c1"} Jul 29 10:29:07.631520 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.631498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" event={"ID":"2aec7501-711c-4885-8a00-ac24d814018f","Type":"ContainerStarted","Data":"c40de08adc40d9ac4a7496e06a4323304ca613b4a7debed081a8f7ac84161f08"} Jul 29 10:29:07.643087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.643060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:07.643189 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.643173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:07.643237 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.643221 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 10:29:07.643279 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.643268 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:07.643310 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.643285 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls podName:1e66bad5-b1c4-4cc2-98ed-e92812fed571 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:08.643266492 +0000 UTC m=+42.733159465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls") pod "cluster-samples-operator-6748489656-74llk" (UID: "1e66bad5-b1c4-4cc2-98ed-e92812fed571") : secret "samples-operator-tls" not found Jul 29 10:29:07.643310 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.643306 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert podName:db8dc379-af2d-4150-b9c2-2e4cd1152d7d nodeName:}" failed. No retries permitted until 2026-07-29 10:29:08.643296221 +0000 UTC m=+42.733189192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d6jzj" (UID: "db8dc379-af2d-4150-b9c2-2e4cd1152d7d") : secret "networking-console-plugin-cert" not found Jul 29 10:29:07.744127 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.744094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.744327 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.744141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:07.744327 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:07.744166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:07.744327 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.744269 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:07.744327 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.744306 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:08.744288054 +0000 UTC m=+42.834181027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:07.744576 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.744347 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:29:07.744576 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.744367 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655f9bb4bd-7mjd2: secret "image-registry-tls" not found Jul 29 10:29:07.744576 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.744379 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:08.744368597 +0000 UTC m=+42.834261558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : secret "router-metrics-certs-default" not found Jul 29 10:29:07.744576 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:07.744417 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls podName:83e869ec-a2c3-4378-adb7-98d16efe23d3 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:08.744402847 +0000 UTC m=+42.834295806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls") pod "image-registry-655f9bb4bd-7mjd2" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3") : secret "image-registry-tls" not found Jul 29 10:29:08.552467 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:08.552424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:08.552973 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:08.552536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:08.552973 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.552554 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:08.552973 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.552632 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls podName:20303846-8a86-4ecd-a03d-9f1104dd04d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.552611859 +0000 UTC m=+44.642504833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hp29z" (UID: "20303846-8a86-4ecd-a03d-9f1104dd04d7") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:08.552973 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.552669 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:08.552973 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.552727 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls podName:c683f5cd-2600-4422-bbb2-5ece4d87838a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:16.552711094 +0000 UTC m=+50.642604050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls") pod "dns-default-xlgwk" (UID: "c683f5cd-2600-4422-bbb2-5ece4d87838a") : secret "dns-default-metrics-tls" not found Jul 29 10:29:08.653369 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:08.653329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:08.653560 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:08.653441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:08.653560 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.653527 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 10:29:08.653667 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.653593 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:08.653667 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.653602 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls podName:1e66bad5-b1c4-4cc2-98ed-e92812fed571 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.653579729 +0000 UTC m=+44.743472722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls") pod "cluster-samples-operator-6748489656-74llk" (UID: "1e66bad5-b1c4-4cc2-98ed-e92812fed571") : secret "samples-operator-tls" not found Jul 29 10:29:08.653667 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.653647 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert podName:db8dc379-af2d-4150-b9c2-2e4cd1152d7d nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.653634631 +0000 UTC m=+44.743527608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d6jzj" (UID: "db8dc379-af2d-4150-b9c2-2e4cd1152d7d") : secret "networking-console-plugin-cert" not found Jul 29 10:29:08.754294 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:08.754252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:08.754489 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:08.754315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:08.754489 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:08.754348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:08.754489 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.754466 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.754446198 +0000 UTC m=+44.844339173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:08.754658 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.754540 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:29:08.754658 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.754554 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655f9bb4bd-7mjd2: secret "image-registry-tls" not found Jul 29 10:29:08.754658 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.754601 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls podName:83e869ec-a2c3-4378-adb7-98d16efe23d3 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.754586106 +0000 UTC m=+44.844479068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls") pod "image-registry-655f9bb4bd-7mjd2" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3") : secret "image-registry-tls" not found Jul 29 10:29:08.754810 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.754663 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:08.754810 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:08.754689 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:10.754681943 +0000 UTC m=+44.844574898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : secret "router-metrics-certs-default" not found Jul 29 10:29:10.570322 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:10.570285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:10.570732 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.570428 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:10.570732 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.570491 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls podName:20303846-8a86-4ecd-a03d-9f1104dd04d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.570474524 +0000 UTC m=+48.660367496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hp29z" (UID: "20303846-8a86-4ecd-a03d-9f1104dd04d7") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:10.671323 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:10.671294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:10.671464 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:10.671381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:10.671464 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.671438 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 10:29:10.671535 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.671499 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls podName:1e66bad5-b1c4-4cc2-98ed-e92812fed571 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.671484431 +0000 UTC m=+48.761377402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls") pod "cluster-samples-operator-6748489656-74llk" (UID: "1e66bad5-b1c4-4cc2-98ed-e92812fed571") : secret "samples-operator-tls" not found Jul 29 10:29:10.671535 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.671522 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:10.671602 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.671570 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert podName:db8dc379-af2d-4150-b9c2-2e4cd1152d7d nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.671556317 +0000 UTC m=+48.761449287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d6jzj" (UID: "db8dc379-af2d-4150-b9c2-2e4cd1152d7d") : secret "networking-console-plugin-cert" not found Jul 29 10:29:10.772503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:10.772478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:10.772640 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:10.772524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:10.772640 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:10.772549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:10.772640 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.772620 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:10.772756 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.772639 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.772625291 +0000 UTC m=+48.862518259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:10.772756 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.772663 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.772654224 +0000 UTC m=+48.862547179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : secret "router-metrics-certs-default" not found Jul 29 10:29:10.772756 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.772662 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:29:10.772756 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.772686 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655f9bb4bd-7mjd2: secret "image-registry-tls" not found Jul 29 10:29:10.772756 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:10.772729 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls podName:83e869ec-a2c3-4378-adb7-98d16efe23d3 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:14.77271803 +0000 UTC m=+48.862610999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls") pod "image-registry-655f9bb4bd-7mjd2" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3") : secret "image-registry-tls" not found Jul 29 10:29:11.643926 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.643845 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-565pv" event={"ID":"5bfffe02-f038-40e3-9087-d10b8b2ab39d","Type":"ContainerStarted","Data":"56a73e21ed18af8e5f27ffabb4fce09b60d9c35eff6983632e0a7a6a28f16435"} Jul 29 10:29:11.645986 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.645955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" event={"ID":"2aec7501-711c-4885-8a00-ac24d814018f","Type":"ContainerStarted","Data":"6999322be423cd92d261da6a8da8e12bb7c2d221f9839f6ca665a5518eb93fcc"} Jul 29 10:29:11.708946 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.708897 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-565pv" podStartSLOduration=2.394382985 podStartE2EDuration="5.708853088s" totalImagesPullingTime="3.314470103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:11.701492941 +0000 UTC m=+45.791385921" watchObservedRunningTime="2026-07-29 10:29:11.708853088 +0000 UTC m=+45.798746065" Jul 29 10:29:11.709396 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.709380 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d47bh"] Jul 29 10:29:11.737673 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.737644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.742977 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.742950 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d47bh"] Jul 29 10:29:11.751239 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.747199 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 10:29:11.751239 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.750884 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 10:29:11.751239 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.751018 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5579t\"" Jul 29 10:29:11.758270 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.758226 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-2pzw7" podStartSLOduration=2.250554617 podStartE2EDuration="5.75821322s" totalImagesPullingTime="3.507658603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:11.758049802 +0000 UTC m=+45.847942780" watchObservedRunningTime="2026-07-29 10:29:11.75821322 +0000 UTC m=+45.848106197" Jul 29 10:29:11.781982 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.781939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.782141 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.782044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08581f27-cdbd-4cb2-855a-ee49a8a54925-crio-socket\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.782185 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.782132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.782224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.782201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08581f27-cdbd-4cb2-855a-ee49a8a54925-data-volume\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.782256 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.782230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc59w\" (UniqueName: \"kubernetes.io/projected/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-api-access-pc59w\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.882655 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.882616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.882824 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.882679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08581f27-cdbd-4cb2-855a-ee49a8a54925-crio-socket\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.882824 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.882732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.882824 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.882778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08581f27-cdbd-4cb2-855a-ee49a8a54925-data-volume\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.882980 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:11.882847 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:29:11.882980 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:11.882882 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:29:11.882980 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.882894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08581f27-cdbd-4cb2-855a-ee49a8a54925-crio-socket\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.882980 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:11.882938 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:12.382917301 +0000 UTC m=+46.472810275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : secret "insights-runtime-extractor-tls" not found Jul 29 10:29:11.882980 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:11.882958 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:12.382947935 +0000 UTC m=+46.472840890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : configmap "kube-rbac-proxy" not found Jul 29 10:29:11.882980 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.882977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc59w\" (UniqueName: \"kubernetes.io/projected/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-api-access-pc59w\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.883196 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.883141 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08581f27-cdbd-4cb2-855a-ee49a8a54925-data-volume\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:11.910309 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:11.910234 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc59w\" (UniqueName: \"kubernetes.io/projected/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-api-access-pc59w\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:12.386257 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:12.386212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:12.386469 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:12.386336 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:29:12.386469 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:12.386375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:12.386469 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:12.386401 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:13.386385249 +0000 UTC m=+47.476278204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : configmap "kube-rbac-proxy" not found Jul 29 10:29:12.386469 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:12.386464 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:29:12.386637 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:12.386519 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:13.386503709 +0000 UTC m=+47.476396667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : secret "insights-runtime-extractor-tls" not found Jul 29 10:29:13.085366 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:13.085337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vqwz_2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f/dns-node-resolver/0.log" Jul 29 10:29:13.395063 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:13.394991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:13.395201 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:13.395078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:13.395201 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:13.395159 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:29:13.395276 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:13.395194 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:29:13.395276 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:13.395219 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:15.395203958 +0000 UTC m=+49.485096916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : secret "insights-runtime-extractor-tls" not found Jul 29 10:29:13.395276 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:13.395248 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:15.395233604 +0000 UTC m=+49.485126559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : configmap "kube-rbac-proxy" not found Jul 29 10:29:14.085185 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.085157 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j9rws_b950870a-55fa-47c1-bc20-91cfaee138f4/node-ca/0.log" Jul 29 10:29:14.607839 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.607803 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:14.608228 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.607967 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:14.608228 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.608040 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls podName:20303846-8a86-4ecd-a03d-9f1104dd04d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:22.608021427 +0000 UTC m=+56.697914396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hp29z" (UID: "20303846-8a86-4ecd-a03d-9f1104dd04d7") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:14.709109 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.709075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:14.709268 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.709239 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 10:29:14.709310 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.709295 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls podName:1e66bad5-b1c4-4cc2-98ed-e92812fed571 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:22.709280582 +0000 UTC m=+56.799173570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls") pod "cluster-samples-operator-6748489656-74llk" (UID: "1e66bad5-b1c4-4cc2-98ed-e92812fed571") : secret "samples-operator-tls" not found Jul 29 10:29:14.709310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.709243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:14.709394 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.709306 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:14.709394 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.709357 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert podName:db8dc379-af2d-4150-b9c2-2e4cd1152d7d nodeName:}" failed. No retries permitted until 2026-07-29 10:29:22.709341861 +0000 UTC m=+56.799234833 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d6jzj" (UID: "db8dc379-af2d-4150-b9c2-2e4cd1152d7d") : secret "networking-console-plugin-cert" not found Jul 29 10:29:14.810195 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.810165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:14.810310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.810210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:14.810310 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.810234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:14.810404 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.810333 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:22.810310125 +0000 UTC m=+56.900203100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:14.810404 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.810348 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:14.810404 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.810376 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:29:14.810404 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.810390 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655f9bb4bd-7mjd2: secret "image-registry-tls" not found Jul 29 10:29:14.810545 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.810418 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:22.810401991 +0000 UTC m=+56.900294960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : secret "router-metrics-certs-default" not found Jul 29 10:29:14.810545 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:14.810433 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls podName:83e869ec-a2c3-4378-adb7-98d16efe23d3 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:22.810427498 +0000 UTC m=+56.900320453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls") pod "image-registry-655f9bb4bd-7mjd2" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3") : secret "image-registry-tls" not found Jul 29 10:29:14.887719 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:14.887650 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4w6d_5fa68c7e-213d-4c6f-8cb4-afdb53a505f9/serve-healthcheck-canary/0.log" Jul 29 10:29:15.416297 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:15.416263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:15.416473 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:15.416368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:15.416473 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:15.416393 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:29:15.416473 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:15.416449 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:29:15.416473 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:15.416461 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:19.416443909 +0000 UTC m=+53.506336867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : configmap "kube-rbac-proxy" not found Jul 29 10:29:15.416609 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:15.416490 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:19.41647891 +0000 UTC m=+53.506371865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : secret "insights-runtime-extractor-tls" not found Jul 29 10:29:16.623659 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:16.623626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:16.624055 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:16.623785 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:29:16.624055 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:16.623846 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls podName:c683f5cd-2600-4422-bbb2-5ece4d87838a nodeName:}" failed. No retries permitted until 2026-07-29 10:29:32.623830251 +0000 UTC m=+66.713723236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls") pod "dns-default-xlgwk" (UID: "c683f5cd-2600-4422-bbb2-5ece4d87838a") : secret "dns-default-metrics-tls" not found Jul 29 10:29:19.447102 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:19.447060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:19.447529 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:19.447161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:19.447529 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:19.447194 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:29:19.447529 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:19.447252 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:27.447237925 +0000 UTC m=+61.537130893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : secret "insights-runtime-extractor-tls" not found Jul 29 10:29:19.447529 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:19.447297 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:29:19.447529 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:19.447379 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:27.447360123 +0000 UTC m=+61.537253083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : configmap "kube-rbac-proxy" not found Jul 29 10:29:22.675274 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.675242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:22.675826 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.675343 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:22.675826 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.675389 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls podName:20303846-8a86-4ecd-a03d-9f1104dd04d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:38.675376743 +0000 UTC m=+72.765269698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hp29z" (UID: "20303846-8a86-4ecd-a03d-9f1104dd04d7") : secret "cluster-monitoring-operator-tls" not found Jul 29 10:29:22.775798 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.775765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:22.775968 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.775888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:22.776052 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.776034 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 10:29:22.776103 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.776094 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert podName:db8dc379-af2d-4150-b9c2-2e4cd1152d7d nodeName:}" failed. No retries permitted until 2026-07-29 10:29:38.776079296 +0000 UTC m=+72.865972251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-d6jzj" (UID: "db8dc379-af2d-4150-b9c2-2e4cd1152d7d") : secret "networking-console-plugin-cert" not found Jul 29 10:29:22.778343 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.778313 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e66bad5-b1c4-4cc2-98ed-e92812fed571-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-74llk\" (UID: \"1e66bad5-b1c4-4cc2-98ed-e92812fed571\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:22.804161 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.804142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" Jul 29 10:29:22.876390 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.876362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:22.876520 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.876409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:22.876520 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.876432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") pod \"image-registry-655f9bb4bd-7mjd2\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:22.876624 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.876526 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 10:29:22.876624 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.876548 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:38.876526322 +0000 UTC m=+72.966419294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : configmap references non-existent config key: service-ca.crt Jul 29 10:29:22.876624 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.876579 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs podName:f1a3923c-6923-48e6-8e7c-48cd9c73ed12 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:38.876563447 +0000 UTC m=+72.966456420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs") pod "router-default-6898c89c69-xzjv2" (UID: "f1a3923c-6923-48e6-8e7c-48cd9c73ed12") : secret "router-metrics-certs-default" not found Jul 29 10:29:22.876624 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.876589 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:29:22.876624 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.876602 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655f9bb4bd-7mjd2: secret "image-registry-tls" not found Jul 29 10:29:22.876891 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:22.876653 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls podName:83e869ec-a2c3-4378-adb7-98d16efe23d3 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:38.876642187 +0000 UTC m=+72.966535161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls") pod "image-registry-655f9bb4bd-7mjd2" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3") : secret "image-registry-tls" not found Jul 29 10:29:22.920753 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:22.920723 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk"] Jul 29 10:29:23.673156 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:23.673109 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" event={"ID":"1e66bad5-b1c4-4cc2-98ed-e92812fed571","Type":"ContainerStarted","Data":"f796a68ee3f8f4315c3062c869b4e52ce9a57f73d5c3ff2a57e905e1953a58eb"} Jul 29 10:29:24.678233 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:24.678147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" event={"ID":"1e66bad5-b1c4-4cc2-98ed-e92812fed571","Type":"ContainerStarted","Data":"06e78e3b08a583cc6df232d0ef84c1404a262858c9657f5c6ed57fb923a0335c"} Jul 29 10:29:24.678233 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:24.678203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" event={"ID":"1e66bad5-b1c4-4cc2-98ed-e92812fed571","Type":"ContainerStarted","Data":"9827c1a39d8b1c2bf0851e99da59dc6b11a95135c9c42d32ae594b5397177c2e"} Jul 29 10:29:25.595032 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:25.595005 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64gmd" Jul 29 10:29:25.627867 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:25.627809 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-74llk" podStartSLOduration=18.15551863 podStartE2EDuration="19.627793979s" totalImagesPullingTime="1.472275349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:24.704103272 +0000 UTC m=+58.793996248" watchObservedRunningTime="2026-07-29 10:29:25.627793979 +0000 UTC m=+59.717686955" Jul 29 10:29:27.521342 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:27.521283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:27.521785 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:27.521434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:27.521785 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:27.521595 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:29:27.521785 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:27.521676 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls podName:08581f27-cdbd-4cb2-855a-ee49a8a54925 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:43.521655048 +0000 UTC m=+77.611548019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d47bh" (UID: "08581f27-cdbd-4cb2-855a-ee49a8a54925") : secret "insights-runtime-extractor-tls" not found Jul 29 10:29:27.521936 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:27.521906 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08581f27-cdbd-4cb2-855a-ee49a8a54925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:32.162962 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.162923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:29:32.166363 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.166334 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:29:32.175131 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.175112 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27fd048a-2b59-4ba1-9ae4-a46f2f8a622a-original-pull-secret\") pod \"global-pull-secret-syncer-spzhb\" (UID: \"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a\") " pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:29:32.263693 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.263642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:29:32.263915 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.263740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:29:32.266217 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.266196 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwsr\" (UniqueName: \"kubernetes.io/projected/3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad-kube-api-access-fgwsr\") pod \"network-check-target-pk245\" (UID: \"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad\") " pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:29:32.267175 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.267157 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:29:32.276680 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.276657 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/768a1bdd-30a9-4097-8a09-c4b08dfac2d0-metrics-certs\") pod \"network-metrics-daemon-ccg6m\" (UID: \"768a1bdd-30a9-4097-8a09-c4b08dfac2d0\") " pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:29:32.471883 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.471794 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wmbjw\"" Jul 29 10:29:32.472791 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.472777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spzhb" Jul 29 10:29:32.478375 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.478358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:29:32.480248 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.480213 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l8nkz\"" Jul 29 10:29:32.487727 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.487708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccg6m" Jul 29 10:29:32.617924 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.617836 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pk245"] Jul 29 10:29:32.621594 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:32.621556 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c568fc3_c0c7_4837_8f6b_5ed6e5c49dad.slice/crio-7f45c279b1c5cf877c063b38b1d2f31ca4bfdf03efea9eed88012edbd44291f6 WatchSource:0}: Error finding container 7f45c279b1c5cf877c063b38b1d2f31ca4bfdf03efea9eed88012edbd44291f6: Status 404 returned error can't find the container with id 7f45c279b1c5cf877c063b38b1d2f31ca4bfdf03efea9eed88012edbd44291f6 Jul 29 10:29:32.631970 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.631938 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-spzhb"] Jul 29 10:29:32.634829 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:32.634806 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fd048a_2b59_4ba1_9ae4_a46f2f8a622a.slice/crio-d92e7659b6eb14e0490dc41fa7e80bef843469f3906fcb596d19dc89a0c1ebe4 WatchSource:0}: Error finding container d92e7659b6eb14e0490dc41fa7e80bef843469f3906fcb596d19dc89a0c1ebe4: Status 404 returned error can't find the container with id d92e7659b6eb14e0490dc41fa7e80bef843469f3906fcb596d19dc89a0c1ebe4 Jul 29 10:29:32.649399 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.649287 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ccg6m"] Jul 29 10:29:32.651624 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:32.651601 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768a1bdd_30a9_4097_8a09_c4b08dfac2d0.slice/crio-b4aa74d822b0233453e9f2289fc25df3fd348f4dccfa5b1e76a13fbd1e1b6b7e WatchSource:0}: Error finding container b4aa74d822b0233453e9f2289fc25df3fd348f4dccfa5b1e76a13fbd1e1b6b7e: Status 404 returned error can't find the container with id b4aa74d822b0233453e9f2289fc25df3fd348f4dccfa5b1e76a13fbd1e1b6b7e Jul 29 10:29:32.667772 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.667751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:32.669768 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.669752 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c683f5cd-2600-4422-bbb2-5ece4d87838a-metrics-tls\") pod \"dns-default-xlgwk\" (UID: \"c683f5cd-2600-4422-bbb2-5ece4d87838a\") " pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:32.699891 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.699851 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-spzhb" event={"ID":"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a","Type":"ContainerStarted","Data":"d92e7659b6eb14e0490dc41fa7e80bef843469f3906fcb596d19dc89a0c1ebe4"} Jul 29 10:29:32.700848 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.700826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccg6m" event={"ID":"768a1bdd-30a9-4097-8a09-c4b08dfac2d0","Type":"ContainerStarted","Data":"b4aa74d822b0233453e9f2289fc25df3fd348f4dccfa5b1e76a13fbd1e1b6b7e"} Jul 29 10:29:32.702084 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.702064 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pk245" event={"ID":"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad","Type":"ContainerStarted","Data":"89e0225b0535d4849bf34153321c4778c3d5437ea6fda8442c9ebff53cd2b027"} Jul 29 10:29:32.702157 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.702103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pk245" event={"ID":"3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad","Type":"ContainerStarted","Data":"7f45c279b1c5cf877c063b38b1d2f31ca4bfdf03efea9eed88012edbd44291f6"} Jul 29 10:29:32.702201 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.702190 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:29:32.720288 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.720244 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pk245" podStartSLOduration=66.720231191 podStartE2EDuration="1m6.720231191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:32.719568766 +0000 UTC m=+66.809461743" watchObservedRunningTime="2026-07-29 10:29:32.720231191 +0000 UTC m=+66.810124167" Jul 29 10:29:32.911015 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.910990 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rxxsv\"" Jul 29 10:29:32.917825 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:32.917806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:33.042707 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:33.042674 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlgwk"] Jul 29 10:29:33.045760 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:33.045729 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc683f5cd_2600_4422_bbb2_5ece4d87838a.slice/crio-72505c810da5222509a074a9fa8cf42b9935330d921e6ece6df848296b5fecbc WatchSource:0}: Error finding container 72505c810da5222509a074a9fa8cf42b9935330d921e6ece6df848296b5fecbc: Status 404 returned error can't find the container with id 72505c810da5222509a074a9fa8cf42b9935330d921e6ece6df848296b5fecbc Jul 29 10:29:33.708196 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:33.708152 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlgwk" event={"ID":"c683f5cd-2600-4422-bbb2-5ece4d87838a","Type":"ContainerStarted","Data":"72505c810da5222509a074a9fa8cf42b9935330d921e6ece6df848296b5fecbc"} Jul 29 10:29:34.714380 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:34.714286 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccg6m" event={"ID":"768a1bdd-30a9-4097-8a09-c4b08dfac2d0","Type":"ContainerStarted","Data":"729493f4c4dd1c5c9618cf2f8b1b1e203f352ecb5dc4512c2b97a54996247cc1"} Jul 29 10:29:34.714380 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:34.714355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccg6m" event={"ID":"768a1bdd-30a9-4097-8a09-c4b08dfac2d0","Type":"ContainerStarted","Data":"fd13781800a6d9066397a7f85469af0cf0b89520ad452ad6f8407194443eb633"} Jul 29 10:29:34.732652 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:34.732424 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ccg6m" podStartSLOduration=67.232211394 podStartE2EDuration="1m8.732404981s" totalImagesPullingTime="1.500193587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:34.731721692 +0000 UTC m=+68.821614672" watchObservedRunningTime="2026-07-29 10:29:34.732404981 +0000 UTC m=+68.822297962" Jul 29 10:29:36.530229 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.530198 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb"] Jul 29 10:29:36.532627 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.532608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.537270 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.537086 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2vnzd\"" Jul 29 10:29:36.537270 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.537143 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 10:29:36.537270 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.537170 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 10:29:36.537270 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.537093 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 10:29:36.537270 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.537150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 10:29:36.546360 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.546332 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb"] Jul 29 10:29:36.592206 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.592172 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655f9bb4bd-7mjd2"] Jul 29 10:29:36.592425 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:36.592401 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" podUID="83e869ec-a2c3-4378-adb7-98d16efe23d3" Jul 29 10:29:36.699313 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.699287 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995cs\" (UniqueName: \"kubernetes.io/projected/5f235cc2-d798-4f4f-92cf-d55718aa73ab-kube-api-access-995cs\") pod \"managed-serviceaccount-addon-agent-64f9dfb846-bwgtb\" (UID: \"5f235cc2-d798-4f4f-92cf-d55718aa73ab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.699420 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.699404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f235cc2-d798-4f4f-92cf-d55718aa73ab-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64f9dfb846-bwgtb\" (UID: \"5f235cc2-d798-4f4f-92cf-d55718aa73ab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.721576 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.721552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:36.787393 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.787318 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:36.800265 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.800244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995cs\" (UniqueName: \"kubernetes.io/projected/5f235cc2-d798-4f4f-92cf-d55718aa73ab-kube-api-access-995cs\") pod \"managed-serviceaccount-addon-agent-64f9dfb846-bwgtb\" (UID: \"5f235cc2-d798-4f4f-92cf-d55718aa73ab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.800353 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.800327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f235cc2-d798-4f4f-92cf-d55718aa73ab-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64f9dfb846-bwgtb\" (UID: \"5f235cc2-d798-4f4f-92cf-d55718aa73ab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.802600 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.802582 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f235cc2-d798-4f4f-92cf-d55718aa73ab-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64f9dfb846-bwgtb\" (UID: \"5f235cc2-d798-4f4f-92cf-d55718aa73ab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.810113 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.810075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-995cs\" (UniqueName: \"kubernetes.io/projected/5f235cc2-d798-4f4f-92cf-d55718aa73ab-kube-api-access-995cs\") pod \"managed-serviceaccount-addon-agent-64f9dfb846-bwgtb\" (UID: \"5f235cc2-d798-4f4f-92cf-d55718aa73ab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.850985 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.850959 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" Jul 29 10:29:36.901704 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.901604 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-bound-sa-token\") pod \"83e869ec-a2c3-4378-adb7-98d16efe23d3\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " Jul 29 10:29:36.901704 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.901659 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms44t\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-kube-api-access-ms44t\") pod \"83e869ec-a2c3-4378-adb7-98d16efe23d3\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " Jul 29 10:29:36.901835 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.901710 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-image-registry-private-configuration\") pod \"83e869ec-a2c3-4378-adb7-98d16efe23d3\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " Jul 29 10:29:36.901835 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.901750 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83e869ec-a2c3-4378-adb7-98d16efe23d3-ca-trust-extracted\") pod \"83e869ec-a2c3-4378-adb7-98d16efe23d3\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " Jul 29 10:29:36.901835 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.901783 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-installation-pull-secrets\") pod \"83e869ec-a2c3-4378-adb7-98d16efe23d3\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " Jul 29 10:29:36.902001 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.901831 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-certificates\") pod \"83e869ec-a2c3-4378-adb7-98d16efe23d3\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " Jul 29 10:29:36.902001 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.901896 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-trusted-ca\") pod \"83e869ec-a2c3-4378-adb7-98d16efe23d3\" (UID: \"83e869ec-a2c3-4378-adb7-98d16efe23d3\") " Jul 29 10:29:36.903215 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.902508 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "83e869ec-a2c3-4378-adb7-98d16efe23d3" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:29:36.903215 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.903099 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "83e869ec-a2c3-4378-adb7-98d16efe23d3" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:29:36.903215 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.903174 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83e869ec-a2c3-4378-adb7-98d16efe23d3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "83e869ec-a2c3-4378-adb7-98d16efe23d3" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:29:36.904514 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.904471 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "83e869ec-a2c3-4378-adb7-98d16efe23d3" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:29:36.906087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.906056 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "83e869ec-a2c3-4378-adb7-98d16efe23d3" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:29:36.906616 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.906581 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "83e869ec-a2c3-4378-adb7-98d16efe23d3" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:29:36.906735 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.906716 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-kube-api-access-ms44t" (OuterVolumeSpecName: "kube-api-access-ms44t") pod "83e869ec-a2c3-4378-adb7-98d16efe23d3" (UID: "83e869ec-a2c3-4378-adb7-98d16efe23d3"). InnerVolumeSpecName "kube-api-access-ms44t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:29:36.985621 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:36.985588 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb"] Jul 29 10:29:36.989075 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:36.989043 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f235cc2_d798_4f4f_92cf_d55718aa73ab.slice/crio-f2f20397c7adb2fc9e9067ea1fabbd8a4bb012cb44c8483a851db3438fde06bd WatchSource:0}: Error finding container f2f20397c7adb2fc9e9067ea1fabbd8a4bb012cb44c8483a851db3438fde06bd: Status 404 returned error can't find the container with id f2f20397c7adb2fc9e9067ea1fabbd8a4bb012cb44c8483a851db3438fde06bd Jul 29 10:29:37.002750 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.002729 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/83e869ec-a2c3-4378-adb7-98d16efe23d3-ca-trust-extracted\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:37.002750 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.002748 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-installation-pull-secrets\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:37.002893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.002760 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-certificates\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:37.002893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.002769 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83e869ec-a2c3-4378-adb7-98d16efe23d3-trusted-ca\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:37.002893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.002778 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-bound-sa-token\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:37.002893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.002787 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms44t\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-kube-api-access-ms44t\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:37.002893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.002795 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/83e869ec-a2c3-4378-adb7-98d16efe23d3-image-registry-private-configuration\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:37.727687 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.727638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-spzhb" event={"ID":"27fd048a-2b59-4ba1-9ae4-a46f2f8a622a","Type":"ContainerStarted","Data":"8a81683fce70867ff5abd2204802fc35229baee5e6f43db285978e2e73310f78"} Jul 29 10:29:37.728987 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.728955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" event={"ID":"5f235cc2-d798-4f4f-92cf-d55718aa73ab","Type":"ContainerStarted","Data":"f2f20397c7adb2fc9e9067ea1fabbd8a4bb012cb44c8483a851db3438fde06bd"} Jul 29 10:29:37.730700 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.730653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655f9bb4bd-7mjd2" Jul 29 10:29:37.730700 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.730689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlgwk" event={"ID":"c683f5cd-2600-4422-bbb2-5ece4d87838a","Type":"ContainerStarted","Data":"6b2a0baa5aa88c9a18804dacdbab4d7e624c08c92b088e9183b3cec6bf8ff764"} Jul 29 10:29:37.730885 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.730733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlgwk" event={"ID":"c683f5cd-2600-4422-bbb2-5ece4d87838a","Type":"ContainerStarted","Data":"bfba652a42575afb92c09c77de19f51cf82476e709d6a97e2149e62fedfec2dc"} Jul 29 10:29:37.731050 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.731033 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:37.746383 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.746340 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-spzhb" podStartSLOduration=67.709739409 podStartE2EDuration="1m11.746326197s" totalImagesPullingTime="4.036586788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:37.744926937 +0000 UTC m=+71.834819983" watchObservedRunningTime="2026-07-29 10:29:37.746326197 +0000 UTC m=+71.836219170" Jul 29 10:29:37.775179 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.775153 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655f9bb4bd-7mjd2"] Jul 29 10:29:37.780550 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.780524 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-655f9bb4bd-7mjd2"] Jul 29 10:29:37.798653 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.798610 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xlgwk" podStartSLOduration=34.209462429 podStartE2EDuration="37.798597043s" totalImagesPullingTime="3.589134614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:37.797549318 +0000 UTC m=+71.887442297" watchObservedRunningTime="2026-07-29 10:29:37.798597043 +0000 UTC m=+71.888490021" Jul 29 10:29:37.911065 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:37.911016 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/83e869ec-a2c3-4378-adb7-98d16efe23d3-registry-tls\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:29:38.458231 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.458193 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83e869ec-a2c3-4378-adb7-98d16efe23d3" path="/var/lib/kubelet/pods/83e869ec-a2c3-4378-adb7-98d16efe23d3/volumes" Jul 29 10:29:38.718133 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.718054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:38.720761 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.720726 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20303846-8a86-4ecd-a03d-9f1104dd04d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hp29z\" (UID: \"20303846-8a86-4ecd-a03d-9f1104dd04d7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:38.819376 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.819328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:38.821817 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.821787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db8dc379-af2d-4150-b9c2-2e4cd1152d7d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-d6jzj\" (UID: \"db8dc379-af2d-4150-b9c2-2e4cd1152d7d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:38.910457 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.910425 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r2bcz\"" Jul 29 10:29:38.917772 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.917747 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" Jul 29 10:29:38.919836 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.919807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:38.919964 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.919886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:38.920413 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.920390 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-service-ca-bundle\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:38.922357 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:38.922333 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1a3923c-6923-48e6-8e7c-48cd9c73ed12-metrics-certs\") pod \"router-default-6898c89c69-xzjv2\" (UID: \"f1a3923c-6923-48e6-8e7c-48cd9c73ed12\") " pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:39.034935 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:39.034901 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wh72k\"" Jul 29 10:29:39.042595 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:39.042569 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" Jul 29 10:29:39.131798 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:39.131767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7p4jk\"" Jul 29 10:29:39.139742 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:39.139708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:39.822444 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:39.822418 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj"] Jul 29 10:29:39.826386 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:39.826351 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8dc379_af2d_4150_b9c2_2e4cd1152d7d.slice/crio-030bfd6285b73a8f6d9ef1a7c05dedb76faa4ec44d9b455b5bd58bbaf3c216ae WatchSource:0}: Error finding container 030bfd6285b73a8f6d9ef1a7c05dedb76faa4ec44d9b455b5bd58bbaf3c216ae: Status 404 returned error can't find the container with id 030bfd6285b73a8f6d9ef1a7c05dedb76faa4ec44d9b455b5bd58bbaf3c216ae Jul 29 10:29:40.035703 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.035676 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z"] Jul 29 10:29:40.038386 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.038355 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6898c89c69-xzjv2"] Jul 29 10:29:40.038779 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:40.038748 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20303846_8a86_4ecd_a03d_9f1104dd04d7.slice/crio-9447198041ddd4ac36499591beb91b5f258148c276a52250ca2e423cece7b104 WatchSource:0}: Error finding container 9447198041ddd4ac36499591beb91b5f258148c276a52250ca2e423cece7b104: Status 404 returned error can't find the container with id 9447198041ddd4ac36499591beb91b5f258148c276a52250ca2e423cece7b104 Jul 29 10:29:40.042261 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:40.042226 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a3923c_6923_48e6_8e7c_48cd9c73ed12.slice/crio-945be349f6890fdc1d2dcb5de9e68ef609f5d3ea2131fe50a237d9dfc16821a0 WatchSource:0}: Error finding container 945be349f6890fdc1d2dcb5de9e68ef609f5d3ea2131fe50a237d9dfc16821a0: Status 404 returned error can't find the container with id 945be349f6890fdc1d2dcb5de9e68ef609f5d3ea2131fe50a237d9dfc16821a0 Jul 29 10:29:40.749064 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.749031 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" event={"ID":"20303846-8a86-4ecd-a03d-9f1104dd04d7","Type":"ContainerStarted","Data":"9447198041ddd4ac36499591beb91b5f258148c276a52250ca2e423cece7b104"} Jul 29 10:29:40.750282 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.750254 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" event={"ID":"db8dc379-af2d-4150-b9c2-2e4cd1152d7d","Type":"ContainerStarted","Data":"030bfd6285b73a8f6d9ef1a7c05dedb76faa4ec44d9b455b5bd58bbaf3c216ae"} Jul 29 10:29:40.752002 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.751950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" event={"ID":"5f235cc2-d798-4f4f-92cf-d55718aa73ab","Type":"ContainerStarted","Data":"5fc361ac00882e5fffbcbe87d6a18a73f41361791f02f8bba429810da5cc2d4e"} Jul 29 10:29:40.753608 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.753581 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6898c89c69-xzjv2" event={"ID":"f1a3923c-6923-48e6-8e7c-48cd9c73ed12","Type":"ContainerStarted","Data":"21ec3829c4747667511539c9b9e4779f121933829a6cdcff62715a8188de3988"} Jul 29 10:29:40.753691 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.753625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6898c89c69-xzjv2" event={"ID":"f1a3923c-6923-48e6-8e7c-48cd9c73ed12","Type":"ContainerStarted","Data":"945be349f6890fdc1d2dcb5de9e68ef609f5d3ea2131fe50a237d9dfc16821a0"} Jul 29 10:29:40.775145 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.775099 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64f9dfb846-bwgtb" podStartSLOduration=2.016833881 podStartE2EDuration="4.77508625s" totalImagesPullingTime="2.758252369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:40.774271943 +0000 UTC m=+74.864164921" watchObservedRunningTime="2026-07-29 10:29:40.77508625 +0000 UTC m=+74.864979254" Jul 29 10:29:40.800701 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:40.800582 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6898c89c69-xzjv2" podStartSLOduration=34.800562105 podStartE2EDuration="34.800562105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:40.799615073 +0000 UTC m=+74.889508049" watchObservedRunningTime="2026-07-29 10:29:40.800562105 +0000 UTC m=+74.890455083" Jul 29 10:29:41.140332 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:41.140305 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:41.143115 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:41.143094 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:41.759394 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:41.759355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" event={"ID":"db8dc379-af2d-4150-b9c2-2e4cd1152d7d","Type":"ContainerStarted","Data":"1344d760a15202c42d967d746c07182ff68a2109829759eab0406ecf32aa939e"} Jul 29 10:29:41.759662 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:41.759640 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:41.761037 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:41.761016 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6898c89c69-xzjv2" Jul 29 10:29:41.777584 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:41.777536 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-d6jzj" podStartSLOduration=34.542869273 podStartE2EDuration="35.777522312s" totalImagesPullingTime="1.234653039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:41.77689983 +0000 UTC m=+75.866792809" watchObservedRunningTime="2026-07-29 10:29:41.777522312 +0000 UTC m=+75.867415289" Jul 29 10:29:42.677713 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.677682 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6"] Jul 29 10:29:42.695765 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.695739 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6"] Jul 29 10:29:42.695958 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.695849 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" Jul 29 10:29:42.698579 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.698559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 10:29:42.698907 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.698886 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5h47h\"" Jul 29 10:29:42.766293 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.766257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" event={"ID":"20303846-8a86-4ecd-a03d-9f1104dd04d7","Type":"ContainerStarted","Data":"a3cc99204cc955707e3e6c82cfa994bf6c35346d93e23a7146250195f42170f2"} Jul 29 10:29:42.784949 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.784904 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" podStartSLOduration=34.661448378 podStartE2EDuration="36.784889248s" totalImagesPullingTime="2.12344087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:42.783942898 +0000 UTC m=+76.873835922" watchObservedRunningTime="2026-07-29 10:29:42.784889248 +0000 UTC m=+76.874782224" Jul 29 10:29:42.852107 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.852063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d17da0f-479c-4dcf-aaea-afd82e1dcbc8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-hlst6\" (UID: \"1d17da0f-479c-4dcf-aaea-afd82e1dcbc8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" Jul 29 10:29:42.953738 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.953644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d17da0f-479c-4dcf-aaea-afd82e1dcbc8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-hlst6\" (UID: \"1d17da0f-479c-4dcf-aaea-afd82e1dcbc8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" Jul 29 10:29:42.956164 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:42.956129 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1d17da0f-479c-4dcf-aaea-afd82e1dcbc8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-hlst6\" (UID: \"1d17da0f-479c-4dcf-aaea-afd82e1dcbc8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" Jul 29 10:29:43.007315 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.007047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" Jul 29 10:29:43.152215 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.152185 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6"] Jul 29 10:29:43.155334 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:43.155305 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d17da0f_479c_4dcf_aaea_afd82e1dcbc8.slice/crio-32d0a92ca326a1d9e3a67e8ba6b0a04b8485310c9abd5c03e86175f68516ee11 WatchSource:0}: Error finding container 32d0a92ca326a1d9e3a67e8ba6b0a04b8485310c9abd5c03e86175f68516ee11: Status 404 returned error can't find the container with id 32d0a92ca326a1d9e3a67e8ba6b0a04b8485310c9abd5c03e86175f68516ee11 Jul 29 10:29:43.558645 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.558612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:43.560872 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.560842 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08581f27-cdbd-4cb2-855a-ee49a8a54925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d47bh\" (UID: \"08581f27-cdbd-4cb2-855a-ee49a8a54925\") " pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:43.771252 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.771218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" event={"ID":"1d17da0f-479c-4dcf-aaea-afd82e1dcbc8","Type":"ContainerStarted","Data":"32d0a92ca326a1d9e3a67e8ba6b0a04b8485310c9abd5c03e86175f68516ee11"} Jul 29 10:29:43.851105 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.851031 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5579t\"" Jul 29 10:29:43.858736 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.858718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d47bh" Jul 29 10:29:43.999770 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:43.999738 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d47bh"] Jul 29 10:29:44.230768 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:44.230698 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08581f27_cdbd_4cb2_855a_ee49a8a54925.slice/crio-b9fbfabc02b0c9a5704c6fd8ca4c72d18133e6ad48527835f3f93a68723f23bd WatchSource:0}: Error finding container b9fbfabc02b0c9a5704c6fd8ca4c72d18133e6ad48527835f3f93a68723f23bd: Status 404 returned error can't find the container with id b9fbfabc02b0c9a5704c6fd8ca4c72d18133e6ad48527835f3f93a68723f23bd Jul 29 10:29:44.779809 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:44.779773 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" event={"ID":"1d17da0f-479c-4dcf-aaea-afd82e1dcbc8","Type":"ContainerStarted","Data":"b1527a2c3b4c09e083519b26cf2a94de06ef05d46821d33ad130db84c5a3f819"} Jul 29 10:29:44.780269 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:44.779974 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" Jul 29 10:29:44.781968 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:44.781943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d47bh" event={"ID":"08581f27-cdbd-4cb2-855a-ee49a8a54925","Type":"ContainerStarted","Data":"b9fbfabc02b0c9a5704c6fd8ca4c72d18133e6ad48527835f3f93a68723f23bd"} Jul 29 10:29:44.786103 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:44.786069 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" Jul 29 10:29:44.798333 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:44.798286 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-hlst6" podStartSLOduration=1.676277451 podStartE2EDuration="2.798267758s" totalImagesPullingTime="1.121990307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:44.797627697 +0000 UTC m=+78.887520676" watchObservedRunningTime="2026-07-29 10:29:44.798267758 +0000 UTC m=+78.888160736" Jul 29 10:29:45.739971 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.739937 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-2t65j"] Jul 29 10:29:45.743179 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.743154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.747790 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.747765 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 10:29:45.747952 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.747842 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 10:29:45.747952 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.747922 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pcs56\"" Jul 29 10:29:45.747952 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.747771 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 10:29:45.754482 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.754458 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-2t65j"] Jul 29 10:29:45.878323 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.878288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a27db542-f898-4d44-af7d-2691498fd1ec-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.878323 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.878334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krsqp\" (UniqueName: \"kubernetes.io/projected/a27db542-f898-4d44-af7d-2691498fd1ec-kube-api-access-krsqp\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.878818 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.878408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a27db542-f898-4d44-af7d-2691498fd1ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.878818 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.878480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a27db542-f898-4d44-af7d-2691498fd1ec-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.979678 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.979642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a27db542-f898-4d44-af7d-2691498fd1ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.979845 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.979702 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a27db542-f898-4d44-af7d-2691498fd1ec-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.979845 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.979763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a27db542-f898-4d44-af7d-2691498fd1ec-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.979845 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.979805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krsqp\" (UniqueName: \"kubernetes.io/projected/a27db542-f898-4d44-af7d-2691498fd1ec-kube-api-access-krsqp\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.980679 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.980658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a27db542-f898-4d44-af7d-2691498fd1ec-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.982234 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.982211 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a27db542-f898-4d44-af7d-2691498fd1ec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.982799 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.982773 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a27db542-f898-4d44-af7d-2691498fd1ec-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:45.988593 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:45.988568 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krsqp\" (UniqueName: \"kubernetes.io/projected/a27db542-f898-4d44-af7d-2691498fd1ec-kube-api-access-krsqp\") pod \"prometheus-operator-84d69f794d-2t65j\" (UID: \"a27db542-f898-4d44-af7d-2691498fd1ec\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:46.054361 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:46.054334 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" Jul 29 10:29:46.198523 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:46.198488 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-2t65j"] Jul 29 10:29:46.202386 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:46.202339 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda27db542_f898_4d44_af7d_2691498fd1ec.slice/crio-7f1fc649692660ac9921cad839bb9b211337d728cba8c55190ecef0d66bce5f1 WatchSource:0}: Error finding container 7f1fc649692660ac9921cad839bb9b211337d728cba8c55190ecef0d66bce5f1: Status 404 returned error can't find the container with id 7f1fc649692660ac9921cad839bb9b211337d728cba8c55190ecef0d66bce5f1 Jul 29 10:29:46.791753 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:46.791711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" event={"ID":"a27db542-f898-4d44-af7d-2691498fd1ec","Type":"ContainerStarted","Data":"7f1fc649692660ac9921cad839bb9b211337d728cba8c55190ecef0d66bce5f1"} Jul 29 10:29:48.746168 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:48.746039 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xlgwk" Jul 29 10:29:49.804652 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:49.804614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d47bh" event={"ID":"08581f27-cdbd-4cb2-855a-ee49a8a54925","Type":"ContainerStarted","Data":"34935449da0c8eb09d158d0007f003a880d43a6cf4beedc3939f469fff108cd6"} Jul 29 10:29:49.806438 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:49.806409 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" event={"ID":"a27db542-f898-4d44-af7d-2691498fd1ec","Type":"ContainerStarted","Data":"e03d893f04c2d98e561ade838a3fcb168e654d8f93aeb24390d12c36e2c71c8b"} Jul 29 10:29:49.806553 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:49.806455 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" event={"ID":"a27db542-f898-4d44-af7d-2691498fd1ec","Type":"ContainerStarted","Data":"12d33cdaa5f6190d98b16a457c881528cc61675a788323288c9db6b8a8ed6b33"} Jul 29 10:29:49.826278 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:49.826238 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-2t65j" podStartSLOduration=1.498880811 podStartE2EDuration="4.826225384s" totalImagesPullingTime="3.327344573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:49.823997483 +0000 UTC m=+83.913890470" watchObservedRunningTime="2026-07-29 10:29:49.826225384 +0000 UTC m=+83.916118339" Jul 29 10:29:50.203963 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.203840 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75769bf9-dglwr"] Jul 29 10:29:50.207089 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.207065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.210429 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.210405 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 10:29:50.210720 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.210541 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 10:29:50.211908 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.211887 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 10:29:50.212019 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.211996 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8lgqv\"" Jul 29 10:29:50.212135 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.212115 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 10:29:50.212241 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.212180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 10:29:50.212302 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.212275 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 10:29:50.212354 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.212301 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 10:29:50.218577 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.218554 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 10:29:50.219774 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.219734 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75769bf9-dglwr"] Jul 29 10:29:50.313590 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.313553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dw8\" (UniqueName: \"kubernetes.io/projected/196dd8ab-e35e-40e7-8895-8d5691dfb616-kube-api-access-r7dw8\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.313753 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.313618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-oauth-config\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.313753 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.313687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-service-ca\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.313753 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.313717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-trusted-ca-bundle\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.313966 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.313752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-serving-cert\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.313966 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.313779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-oauth-serving-cert\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.313966 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.313806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-config\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.415097 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.415058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dw8\" (UniqueName: \"kubernetes.io/projected/196dd8ab-e35e-40e7-8895-8d5691dfb616-kube-api-access-r7dw8\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.415264 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.415127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-oauth-config\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.415264 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.415167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-service-ca\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.415264 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.415193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-trusted-ca-bundle\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.415264 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.415220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-serving-cert\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.415264 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.415243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-oauth-serving-cert\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.415513 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.415267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-config\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.416141 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.416103 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-config\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.416268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.416143 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-service-ca\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.416268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.416245 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-trusted-ca-bundle\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.416382 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.416292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-oauth-serving-cert\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.417990 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.417967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-serving-cert\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.418119 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.418101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-oauth-config\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.424823 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.424572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dw8\" (UniqueName: \"kubernetes.io/projected/196dd8ab-e35e-40e7-8895-8d5691dfb616-kube-api-access-r7dw8\") pod \"console-75769bf9-dglwr\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.519957 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.519871 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:29:50.667416 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.667388 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75769bf9-dglwr"] Jul 29 10:29:50.670532 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:50.670505 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196dd8ab_e35e_40e7_8895_8d5691dfb616.slice/crio-b85065cde2cdd4f55568ac0fa65c8a7c9f5e8e25e543d4c2ef0e415397a1831f WatchSource:0}: Error finding container b85065cde2cdd4f55568ac0fa65c8a7c9f5e8e25e543d4c2ef0e415397a1831f: Status 404 returned error can't find the container with id b85065cde2cdd4f55568ac0fa65c8a7c9f5e8e25e543d4c2ef0e415397a1831f Jul 29 10:29:50.811925 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:50.811887 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75769bf9-dglwr" event={"ID":"196dd8ab-e35e-40e7-8895-8d5691dfb616","Type":"ContainerStarted","Data":"b85065cde2cdd4f55568ac0fa65c8a7c9f5e8e25e543d4c2ef0e415397a1831f"} Jul 29 10:29:52.825523 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:52.825379 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:29:52.825523 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:52.825427 2580 generic.go:356] "Generic (PLEG): container finished" podID="20303846-8a86-4ecd-a03d-9f1104dd04d7" containerID="a3cc99204cc955707e3e6c82cfa994bf6c35346d93e23a7146250195f42170f2" exitCode=2 Jul 29 10:29:52.825523 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:52.825505 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" event={"ID":"20303846-8a86-4ecd-a03d-9f1104dd04d7","Type":"ContainerDied","Data":"a3cc99204cc955707e3e6c82cfa994bf6c35346d93e23a7146250195f42170f2"} Jul 29 10:29:52.826110 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:52.825923 2580 scope.go:117] "RemoveContainer" containerID="a3cc99204cc955707e3e6c82cfa994bf6c35346d93e23a7146250195f42170f2" Jul 29 10:29:53.834330 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:53.834292 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:29:53.834818 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:53.834486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hp29z" event={"ID":"20303846-8a86-4ecd-a03d-9f1104dd04d7","Type":"ContainerStarted","Data":"109729df4d0b243fca3cacc8c5942e76707b49e7a1982a7a64cde87d0a5d1326"} Jul 29 10:29:53.837099 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:53.837018 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d47bh" event={"ID":"08581f27-cdbd-4cb2-855a-ee49a8a54925","Type":"ContainerStarted","Data":"b67576a503451014e5b56e33a80ccb1139d49a470e46642647e20161600589ec"} Jul 29 10:29:56.857080 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.857052 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6"] Jul 29 10:29:56.874514 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.874482 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6"] Jul 29 10:29:56.874658 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.874591 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:56.878428 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.878399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 10:29:56.878551 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.878482 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 10:29:56.878788 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.878771 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l79ls\"" Jul 29 10:29:56.891837 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.891814 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b9975"] Jul 29 10:29:56.895385 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.895361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.902593 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.902572 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 10:29:56.902702 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.902622 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 10:29:56.902702 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.902688 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 10:29:56.902919 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.902905 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dcmhg\"" Jul 29 10:29:56.967590 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a473886a-203b-46db-b02d-9da94b869510-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:56.967679 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.967679 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjk75\" (UniqueName: \"kubernetes.io/projected/a473886a-203b-46db-b02d-9da94b869510-kube-api-access-bjk75\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:56.967789 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-root\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.967789 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:56.967919 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.967919 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-tls\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.967919 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a38d9390-1ee1-4a1b-a963-5ea539a323e1-metrics-client-ca\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.968057 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967951 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:56.968057 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.967975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8d7\" (UniqueName: \"kubernetes.io/projected/a38d9390-1ee1-4a1b-a963-5ea539a323e1-kube-api-access-ng8d7\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.968057 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.968001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-sys\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.968057 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.968038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-wtmp\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:56.968173 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:56.968089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-textfile\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.068646 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.068646 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8d7\" (UniqueName: \"kubernetes.io/projected/a38d9390-1ee1-4a1b-a963-5ea539a323e1-kube-api-access-ng8d7\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.068836 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-sys\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.068836 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-wtmp\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.068836 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-textfile\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.068836 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:57.068806 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 10:29:57.068836 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a473886a-203b-46db-b02d-9da94b869510-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:29:57.068885 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-tls podName:a473886a-203b-46db-b02d-9da94b869510 nodeName:}" failed. No retries permitted until 2026-07-29 10:29:57.568849567 +0000 UTC m=+91.658742544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-qkgj6" (UID: "a473886a-203b-46db-b02d-9da94b869510") : secret "openshift-state-metrics-tls" not found Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-wtmp\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjk75\" (UniqueName: \"kubernetes.io/projected/a473886a-203b-46db-b02d-9da94b869510-kube-api-access-bjk75\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.068980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-root\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069015 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-root\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069096 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-tls\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069555 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a38d9390-1ee1-4a1b-a963-5ea539a323e1-metrics-client-ca\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069555 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069234 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-textfile\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069555 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a38d9390-1ee1-4a1b-a963-5ea539a323e1-sys\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069720 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a473886a-203b-46db-b02d-9da94b869510-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.069781 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a38d9390-1ee1-4a1b-a963-5ea539a323e1-metrics-client-ca\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.069781 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.069738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.071460 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.071435 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.071590 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.071569 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.071656 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.071633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a38d9390-1ee1-4a1b-a963-5ea539a323e1-node-exporter-tls\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.093357 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.093333 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjk75\" (UniqueName: \"kubernetes.io/projected/a473886a-203b-46db-b02d-9da94b869510-kube-api-access-bjk75\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.093659 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.093638 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8d7\" (UniqueName: \"kubernetes.io/projected/a38d9390-1ee1-4a1b-a963-5ea539a323e1-kube-api-access-ng8d7\") pod \"node-exporter-b9975\" (UID: \"a38d9390-1ee1-4a1b-a963-5ea539a323e1\") " pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.204736 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.204657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9975" Jul 29 10:29:57.218431 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:57.218392 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38d9390_1ee1_4a1b_a963_5ea539a323e1.slice/crio-acd2b4184ddfe3475a8951d067f3ddced05374d7dc64ea641e209a131ffb36ce WatchSource:0}: Error finding container acd2b4184ddfe3475a8951d067f3ddced05374d7dc64ea641e209a131ffb36ce: Status 404 returned error can't find the container with id acd2b4184ddfe3475a8951d067f3ddced05374d7dc64ea641e209a131ffb36ce Jul 29 10:29:57.572149 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.572116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.574583 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.574559 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a473886a-203b-46db-b02d-9da94b869510-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qkgj6\" (UID: \"a473886a-203b-46db-b02d-9da94b869510\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.784899 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.784850 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" Jul 29 10:29:57.856032 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.855943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d47bh" event={"ID":"08581f27-cdbd-4cb2-855a-ee49a8a54925","Type":"ContainerStarted","Data":"0b375d4760fb672702f7713ea6fbb2754763b6ff5bc4b5077cfc9714be86caf7"} Jul 29 10:29:57.857275 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.857242 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9975" event={"ID":"a38d9390-1ee1-4a1b-a963-5ea539a323e1","Type":"ContainerStarted","Data":"acd2b4184ddfe3475a8951d067f3ddced05374d7dc64ea641e209a131ffb36ce"} Jul 29 10:29:57.859022 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.858996 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75769bf9-dglwr" event={"ID":"196dd8ab-e35e-40e7-8895-8d5691dfb616","Type":"ContainerStarted","Data":"28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3"} Jul 29 10:29:57.912255 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.911134 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d47bh" podStartSLOduration=34.355641049 podStartE2EDuration="46.911111851s" totalImagesPullingTime="12.555470802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:57.88249648 +0000 UTC m=+91.972389456" watchObservedRunningTime="2026-07-29 10:29:57.911111851 +0000 UTC m=+92.001004830" Jul 29 10:29:57.912255 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:57.911662 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75769bf9-dglwr" podStartSLOduration=1.627192066 podStartE2EDuration="7.911652666s" totalImagesPullingTime="6.2844606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:57.909807705 +0000 UTC m=+91.999700683" watchObservedRunningTime="2026-07-29 10:29:57.911652666 +0000 UTC m=+92.001545646" Jul 29 10:29:58.153085 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:58.151399 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6"] Jul 29 10:29:58.155092 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:29:58.155056 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda473886a_203b_46db_b02d_9da94b869510.slice/crio-60a82cb391ea80576b703bb798579543f86f00fa32132846be0b47b5be6dc4d7 WatchSource:0}: Error finding container 60a82cb391ea80576b703bb798579543f86f00fa32132846be0b47b5be6dc4d7: Status 404 returned error can't find the container with id 60a82cb391ea80576b703bb798579543f86f00fa32132846be0b47b5be6dc4d7 Jul 29 10:29:58.865302 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:58.865261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" event={"ID":"a473886a-203b-46db-b02d-9da94b869510","Type":"ContainerStarted","Data":"413d47405c4c6b8d7233b96a9ebc994f7ea0d04449fca879db91c575aa86ea36"} Jul 29 10:29:58.865761 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:58.865324 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" event={"ID":"a473886a-203b-46db-b02d-9da94b869510","Type":"ContainerStarted","Data":"f2e995292b1d16fd73c2214d06c4116de3c4deea11276b42c8f93c0160b3b491"} Jul 29 10:29:58.865761 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:58.865356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" event={"ID":"a473886a-203b-46db-b02d-9da94b869510","Type":"ContainerStarted","Data":"60a82cb391ea80576b703bb798579543f86f00fa32132846be0b47b5be6dc4d7"} Jul 29 10:29:58.867195 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:58.867162 2580 generic.go:356] "Generic (PLEG): container finished" podID="a38d9390-1ee1-4a1b-a963-5ea539a323e1" containerID="5114e9d4b0b1334dd1218ffceab1cc68d7f6f3947a1950a738b8b0318cb57650" exitCode=0 Jul 29 10:29:58.867477 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:58.867439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9975" event={"ID":"a38d9390-1ee1-4a1b-a963-5ea539a323e1","Type":"ContainerDied","Data":"5114e9d4b0b1334dd1218ffceab1cc68d7f6f3947a1950a738b8b0318cb57650"} Jul 29 10:29:59.874316 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:59.874280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" event={"ID":"a473886a-203b-46db-b02d-9da94b869510","Type":"ContainerStarted","Data":"dfa1422358bed3c3af971ed34a57f93dcfeb8bb816869aad3b49737ca94c9c34"} Jul 29 10:29:59.876503 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:59.876478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9975" event={"ID":"a38d9390-1ee1-4a1b-a963-5ea539a323e1","Type":"ContainerStarted","Data":"d1a86e34538fdd8fb484e44a3b2377f2df69a73fa094c79ed871bfb61f2264f0"} Jul 29 10:29:59.876612 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:59.876519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9975" event={"ID":"a38d9390-1ee1-4a1b-a963-5ea539a323e1","Type":"ContainerStarted","Data":"c73b26eb1757d860700a7e5b40a12f6cca4a9f1fbc3348f75bb02ed0f6f72122"} Jul 29 10:29:59.899099 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:59.899056 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qkgj6" podStartSLOduration=2.857975274 podStartE2EDuration="3.899039836s" totalImagesPullingTime="1.041064562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:59.896979527 +0000 UTC m=+93.986872503" watchObservedRunningTime="2026-07-29 10:29:59.899039836 +0000 UTC m=+93.988932813" Jul 29 10:29:59.920828 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:29:59.920788 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b9975" podStartSLOduration=3.012158851 podStartE2EDuration="3.920776503s" totalImagesPullingTime="832.893185ms" totalInitContainerRuntime="75.724467ms" isStatefulPod=true podCreationTimestamp="2026-07-29 10:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:29:59.920011092 +0000 UTC m=+94.009904068" watchObservedRunningTime="2026-07-29 10:29:59.920776503 +0000 UTC m=+94.010669480" Jul 29 10:30:00.520442 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:00.520393 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:30:00.520646 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:00.520465 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:30:00.525309 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:00.525285 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:30:00.889567 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:00.889537 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:30:03.059193 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.059159 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:30:03.063604 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.063574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.066798 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.066766 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 10:30:03.066941 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.066919 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bk08me99m6bru\"" Jul 29 10:30:03.067053 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.067031 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 10:30:03.067115 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.067099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 10:30:03.067288 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.067264 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 10:30:03.067378 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.067309 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 10:30:03.068302 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.068279 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 10:30:03.068465 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.068445 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 10:30:03.068534 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.068497 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 10:30:03.068967 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.068947 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 10:30:03.069058 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.069037 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 10:30:03.069151 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.069135 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5pzkz\"" Jul 29 10:30:03.069315 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.069298 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 10:30:03.069362 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.069328 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 10:30:03.069444 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.069430 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 10:30:03.069496 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.069443 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 10:30:03.071544 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.071265 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 10:30:03.082402 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.082375 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:30:03.115208 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.115171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116052 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-web-config\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116266 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/998776db-7b4a-470c-aa5d-e484635e1ee9-config-out\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116434 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6m6x\" (UniqueName: \"kubernetes.io/projected/998776db-7b4a-470c-aa5d-e484635e1ee9-kube-api-access-l6m6x\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116582 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116738 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116738 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116955 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-config\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116955 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116955 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116955 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.116955 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117295 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.116965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117295 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.117114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/998776db-7b4a-470c-aa5d-e484635e1ee9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117295 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.117170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117295 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.117199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117295 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.117245 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117295 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.117276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117554 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.117303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.117554 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.117332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218059 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-web-config\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218268 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/998776db-7b4a-470c-aa5d-e484635e1ee9-config-out\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6m6x\" (UniqueName: \"kubernetes.io/projected/998776db-7b4a-470c-aa5d-e484635e1ee9-kube-api-access-l6m6x\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-config\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218516 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.218578 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/998776db-7b4a-470c-aa5d-e484635e1ee9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218839 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.218929 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219087 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.219040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219806 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.219779 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.219925 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.219894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.221216 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.221186 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.222962 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.222585 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.222962 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.222904 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.223143 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.223128 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/998776db-7b4a-470c-aa5d-e484635e1ee9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.224110 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.223637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.224110 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.223938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.224110 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.224058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.224322 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.224203 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-config\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.224377 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.224343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-web-config\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.224943 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.224901 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/998776db-7b4a-470c-aa5d-e484635e1ee9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.226134 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.226108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.226217 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.226169 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/998776db-7b4a-470c-aa5d-e484635e1ee9-config-out\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.226599 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.226576 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.227532 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.227513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/998776db-7b4a-470c-aa5d-e484635e1ee9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.227818 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.227801 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6m6x\" (UniqueName: \"kubernetes.io/projected/998776db-7b4a-470c-aa5d-e484635e1ee9-kube-api-access-l6m6x\") pod \"prometheus-k8s-0\" (UID: \"998776db-7b4a-470c-aa5d-e484635e1ee9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.375083 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.374994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:03.539375 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.539336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 10:30:03.542151 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:30:03.542125 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998776db_7b4a_470c_aa5d_e484635e1ee9.slice/crio-34a06d874d980d0a6b1e2cab347b5b4e054486c430630b4b36a0f4159d5e5dd0 WatchSource:0}: Error finding container 34a06d874d980d0a6b1e2cab347b5b4e054486c430630b4b36a0f4159d5e5dd0: Status 404 returned error can't find the container with id 34a06d874d980d0a6b1e2cab347b5b4e054486c430630b4b36a0f4159d5e5dd0 Jul 29 10:30:03.710838 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.710752 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pk245" Jul 29 10:30:03.898817 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:03.898785 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerStarted","Data":"34a06d874d980d0a6b1e2cab347b5b4e054486c430630b4b36a0f4159d5e5dd0"} Jul 29 10:30:04.904415 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:04.904378 2580 generic.go:356] "Generic (PLEG): container finished" podID="998776db-7b4a-470c-aa5d-e484635e1ee9" containerID="ccacd4a537a86af4762626b1298f7c94cb142c504fffeab805411c5a7af36289" exitCode=0 Jul 29 10:30:04.904772 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:04.904461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerDied","Data":"ccacd4a537a86af4762626b1298f7c94cb142c504fffeab805411c5a7af36289"} Jul 29 10:30:08.924433 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:08.924393 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerStarted","Data":"5e6c0d0a81be10463e9d92ea122d6b18ce347b8200a5d8ff4b432332ab92ecdf"} Jul 29 10:30:08.926397 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:08.924482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerStarted","Data":"5a3e86927c886fd9373f1be914ec329601cbeba0c01eebe67d7df262806af186"} Jul 29 10:30:10.936294 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:10.936262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerStarted","Data":"f3cc15350a6fbb2d5c7c570cc708a7bbe04b08d93df37bb2d1f7d3dbb858a36c"} Jul 29 10:30:10.936691 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:10.936353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerStarted","Data":"e2d2743eefa2f6341e6d28b7ae2f5ac4826a104eb3d36eeb4dfa00c8f39f66f4"} Jul 29 10:30:10.936691 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:10.936379 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerStarted","Data":"26e94d97e1f94190b631c970788f311e7ef6f388bacb1ec22e8c7ad561814c56"} Jul 29 10:30:10.936691 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:10.936404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"998776db-7b4a-470c-aa5d-e484635e1ee9","Type":"ContainerStarted","Data":"5fc7ea5d55aa9aa3101778456d70a39390fa64d1740a6e3bbfc6b18519a3198f"} Jul 29 10:30:10.972851 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:10.972802 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.750531278 podStartE2EDuration="7.972787835s" totalImagesPullingTime="6.203802491s" totalInitContainerRuntime="18.454066ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:30:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:30:10.970363144 +0000 UTC m=+105.060256121" watchObservedRunningTime="2026-07-29 10:30:10.972787835 +0000 UTC m=+105.062680836" Jul 29 10:30:13.375655 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:13.375621 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:30:14.304078 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:14.304043 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75769bf9-dglwr"] Jul 29 10:30:39.324373 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.324330 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75769bf9-dglwr" podUID="196dd8ab-e35e-40e7-8895-8d5691dfb616" containerName="console" containerID="cri-o://28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3" gracePeriod=15 Jul 29 10:30:39.563677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.563655 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:30:39.721664 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.721578 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-service-ca\") pod \"196dd8ab-e35e-40e7-8895-8d5691dfb616\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " Jul 29 10:30:39.721664 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.721621 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-config\") pod \"196dd8ab-e35e-40e7-8895-8d5691dfb616\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " Jul 29 10:30:39.721664 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.721643 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-serving-cert\") pod \"196dd8ab-e35e-40e7-8895-8d5691dfb616\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " Jul 29 10:30:39.721977 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.721767 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-trusted-ca-bundle\") pod \"196dd8ab-e35e-40e7-8895-8d5691dfb616\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " Jul 29 10:30:39.721977 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.721816 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7dw8\" (UniqueName: \"kubernetes.io/projected/196dd8ab-e35e-40e7-8895-8d5691dfb616-kube-api-access-r7dw8\") pod \"196dd8ab-e35e-40e7-8895-8d5691dfb616\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " Jul 29 10:30:39.721977 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.721847 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-oauth-config\") pod \"196dd8ab-e35e-40e7-8895-8d5691dfb616\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " Jul 29 10:30:39.721977 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.721901 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-oauth-serving-cert\") pod \"196dd8ab-e35e-40e7-8895-8d5691dfb616\" (UID: \"196dd8ab-e35e-40e7-8895-8d5691dfb616\") " Jul 29 10:30:39.722163 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.722064 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-service-ca" (OuterVolumeSpecName: "service-ca") pod "196dd8ab-e35e-40e7-8895-8d5691dfb616" (UID: "196dd8ab-e35e-40e7-8895-8d5691dfb616"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:30:39.722163 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.722094 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-config" (OuterVolumeSpecName: "console-config") pod "196dd8ab-e35e-40e7-8895-8d5691dfb616" (UID: "196dd8ab-e35e-40e7-8895-8d5691dfb616"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:30:39.722252 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.722177 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "196dd8ab-e35e-40e7-8895-8d5691dfb616" (UID: "196dd8ab-e35e-40e7-8895-8d5691dfb616"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:30:39.722252 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.722234 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-service-ca\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:30:39.722351 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.722251 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-config\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:30:39.722435 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.722412 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "196dd8ab-e35e-40e7-8895-8d5691dfb616" (UID: "196dd8ab-e35e-40e7-8895-8d5691dfb616"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:30:39.724018 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.723982 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/196dd8ab-e35e-40e7-8895-8d5691dfb616-kube-api-access-r7dw8" (OuterVolumeSpecName: "kube-api-access-r7dw8") pod "196dd8ab-e35e-40e7-8895-8d5691dfb616" (UID: "196dd8ab-e35e-40e7-8895-8d5691dfb616"). InnerVolumeSpecName "kube-api-access-r7dw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:30:39.724018 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.723997 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "196dd8ab-e35e-40e7-8895-8d5691dfb616" (UID: "196dd8ab-e35e-40e7-8895-8d5691dfb616"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:30:39.724162 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.724048 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "196dd8ab-e35e-40e7-8895-8d5691dfb616" (UID: "196dd8ab-e35e-40e7-8895-8d5691dfb616"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:30:39.823335 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.823301 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7dw8\" (UniqueName: \"kubernetes.io/projected/196dd8ab-e35e-40e7-8895-8d5691dfb616-kube-api-access-r7dw8\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:30:39.823335 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.823329 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-oauth-config\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:30:39.823335 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.823339 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-oauth-serving-cert\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:30:39.823544 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.823348 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196dd8ab-e35e-40e7-8895-8d5691dfb616-console-serving-cert\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:30:39.823544 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:39.823357 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196dd8ab-e35e-40e7-8895-8d5691dfb616-trusted-ca-bundle\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:30:40.045738 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.045705 2580 generic.go:356] "Generic (PLEG): container finished" podID="196dd8ab-e35e-40e7-8895-8d5691dfb616" containerID="28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3" exitCode=0 Jul 29 10:30:40.045920 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.045750 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75769bf9-dglwr" Jul 29 10:30:40.045920 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.045793 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75769bf9-dglwr" event={"ID":"196dd8ab-e35e-40e7-8895-8d5691dfb616","Type":"ContainerDied","Data":"28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3"} Jul 29 10:30:40.045920 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.045842 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75769bf9-dglwr" event={"ID":"196dd8ab-e35e-40e7-8895-8d5691dfb616","Type":"ContainerDied","Data":"b85065cde2cdd4f55568ac0fa65c8a7c9f5e8e25e543d4c2ef0e415397a1831f"} Jul 29 10:30:40.045920 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.045881 2580 scope.go:117] "RemoveContainer" containerID="28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3" Jul 29 10:30:40.054424 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.054401 2580 scope.go:117] "RemoveContainer" containerID="28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3" Jul 29 10:30:40.054689 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:30:40.054671 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3\": container with ID starting with 28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3 not found: ID does not exist" containerID="28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3" Jul 29 10:30:40.054745 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.054698 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3"} err="failed to get container status \"28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3\": rpc error: code = NotFound desc = could not find container \"28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3\": container with ID starting with 28b52c2a9231792d8075346f623b1d672ddb8a6d294da4fe02ef3512112297f3 not found: ID does not exist" Jul 29 10:30:40.089275 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.089246 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75769bf9-dglwr"] Jul 29 10:30:40.116590 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.112942 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75769bf9-dglwr"] Jul 29 10:30:40.459946 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:40.459849 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="196dd8ab-e35e-40e7-8895-8d5691dfb616" path="/var/lib/kubelet/pods/196dd8ab-e35e-40e7-8895-8d5691dfb616/volumes" Jul 29 10:30:47.075576 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:47.075540 2580 generic.go:356] "Generic (PLEG): container finished" podID="5bfffe02-f038-40e3-9087-d10b8b2ab39d" containerID="56a73e21ed18af8e5f27ffabb4fce09b60d9c35eff6983632e0a7a6a28f16435" exitCode=0 Jul 29 10:30:47.076219 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:47.076193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-565pv" event={"ID":"5bfffe02-f038-40e3-9087-d10b8b2ab39d","Type":"ContainerDied","Data":"56a73e21ed18af8e5f27ffabb4fce09b60d9c35eff6983632e0a7a6a28f16435"} Jul 29 10:30:47.076679 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:47.076658 2580 scope.go:117] "RemoveContainer" containerID="56a73e21ed18af8e5f27ffabb4fce09b60d9c35eff6983632e0a7a6a28f16435" Jul 29 10:30:48.082121 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:30:48.082085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-565pv" event={"ID":"5bfffe02-f038-40e3-9087-d10b8b2ab39d","Type":"ContainerStarted","Data":"98cca85618f32f806dd45d82506f73ad0a66ab458a9496e0e28b7c87b508b967"} Jul 29 10:31:03.375924 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:31:03.375885 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:31:03.392116 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:31:03.392091 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:31:04.155625 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:31:04.155591 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 10:33:26.313642 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:33:26.313614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:33:26.323583 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:33:26.323556 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:33:26.327000 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:33:26.326977 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 10:35:43.731145 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.731110 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-2r7k7"] Jul 29 10:35:43.731584 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.731405 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196dd8ab-e35e-40e7-8895-8d5691dfb616" containerName="console" Jul 29 10:35:43.731584 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.731418 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="196dd8ab-e35e-40e7-8895-8d5691dfb616" containerName="console" Jul 29 10:35:43.731584 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.731487 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="196dd8ab-e35e-40e7-8895-8d5691dfb616" containerName="console" Jul 29 10:35:43.734523 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.734508 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2r7k7" Jul 29 10:35:43.737543 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.737524 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 10:35:43.739007 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.738986 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 29 10:35:43.739107 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.739025 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-xd789\"" Jul 29 10:35:43.739107 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.739039 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 10:35:43.743244 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.743222 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-2r7k7"] Jul 29 10:35:43.804008 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.803983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcwrh\" (UniqueName: \"kubernetes.io/projected/23458eaa-1ca6-4ac8-86cd-5903cce7db03-kube-api-access-zcwrh\") pod \"s3-init-2r7k7\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " pod="kserve/s3-init-2r7k7" Jul 29 10:35:43.804133 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.804048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23458eaa-1ca6-4ac8-86cd-5903cce7db03-model-cache\") pod \"s3-init-2r7k7\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " pod="kserve/s3-init-2r7k7" Jul 29 10:35:43.905106 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.905080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcwrh\" (UniqueName: \"kubernetes.io/projected/23458eaa-1ca6-4ac8-86cd-5903cce7db03-kube-api-access-zcwrh\") pod \"s3-init-2r7k7\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " pod="kserve/s3-init-2r7k7" Jul 29 10:35:43.905245 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.905151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23458eaa-1ca6-4ac8-86cd-5903cce7db03-model-cache\") pod \"s3-init-2r7k7\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " pod="kserve/s3-init-2r7k7" Jul 29 10:35:43.905478 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.905463 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23458eaa-1ca6-4ac8-86cd-5903cce7db03-model-cache\") pod \"s3-init-2r7k7\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " pod="kserve/s3-init-2r7k7" Jul 29 10:35:43.913243 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:43.913220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcwrh\" (UniqueName: \"kubernetes.io/projected/23458eaa-1ca6-4ac8-86cd-5903cce7db03-kube-api-access-zcwrh\") pod \"s3-init-2r7k7\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " pod="kserve/s3-init-2r7k7" Jul 29 10:35:44.044893 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:44.044854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2r7k7" Jul 29 10:35:44.169771 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:44.169742 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-2r7k7"] Jul 29 10:35:44.172510 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:35:44.172481 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23458eaa_1ca6_4ac8_86cd_5903cce7db03.slice/crio-f587b844b36486d992d9a2384058308724a5c2087716dcddeed5c19aea7cd1d0 WatchSource:0}: Error finding container f587b844b36486d992d9a2384058308724a5c2087716dcddeed5c19aea7cd1d0: Status 404 returned error can't find the container with id f587b844b36486d992d9a2384058308724a5c2087716dcddeed5c19aea7cd1d0 Jul 29 10:35:44.174295 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:44.174259 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:35:45.169498 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:45.169464 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2r7k7" event={"ID":"23458eaa-1ca6-4ac8-86cd-5903cce7db03","Type":"ContainerStarted","Data":"f587b844b36486d992d9a2384058308724a5c2087716dcddeed5c19aea7cd1d0"} Jul 29 10:35:49.187554 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:49.187500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2r7k7" event={"ID":"23458eaa-1ca6-4ac8-86cd-5903cce7db03","Type":"ContainerStarted","Data":"923f99db0c3da3d597ca14766150c5feb24a74ce93a1ea55fdc108ffe04f2f8b"} Jul 29 10:35:50.193267 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:50.193236 2580 generic.go:356] "Generic (PLEG): container finished" podID="23458eaa-1ca6-4ac8-86cd-5903cce7db03" containerID="923f99db0c3da3d597ca14766150c5feb24a74ce93a1ea55fdc108ffe04f2f8b" exitCode=0 Jul 29 10:35:50.193645 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:50.193321 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2r7k7" event={"ID":"23458eaa-1ca6-4ac8-86cd-5903cce7db03","Type":"ContainerDied","Data":"923f99db0c3da3d597ca14766150c5feb24a74ce93a1ea55fdc108ffe04f2f8b"} Jul 29 10:35:55.217013 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:55.216982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2r7k7" event={"ID":"23458eaa-1ca6-4ac8-86cd-5903cce7db03","Type":"ContainerStarted","Data":"34a8bd68d6ecd58ca8a4a0a85fa1b837c832c06a15acfcfd5610dfcd12a4b091"} Jul 29 10:35:55.235715 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:35:55.235669 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-2r7k7" podStartSLOduration=2.017701756 podStartE2EDuration="12.235653617s" totalImagesPullingTime="8.523973194s" totalInitContainerRuntime="1.693978667s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:35:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:35:55.234579383 +0000 UTC m=+449.324472360" watchObservedRunningTime="2026-07-29 10:35:55.235653617 +0000 UTC m=+449.325546594" Jul 29 10:37:00.469535 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:00.469500 2580 generic.go:356] "Generic (PLEG): container finished" podID="23458eaa-1ca6-4ac8-86cd-5903cce7db03" containerID="34a8bd68d6ecd58ca8a4a0a85fa1b837c832c06a15acfcfd5610dfcd12a4b091" exitCode=0 Jul 29 10:37:00.469535 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:00.469547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2r7k7" event={"ID":"23458eaa-1ca6-4ac8-86cd-5903cce7db03","Type":"ContainerDied","Data":"34a8bd68d6ecd58ca8a4a0a85fa1b837c832c06a15acfcfd5610dfcd12a4b091"} Jul 29 10:37:01.598575 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:01.598550 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2r7k7" Jul 29 10:37:01.731591 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:01.731484 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcwrh\" (UniqueName: \"kubernetes.io/projected/23458eaa-1ca6-4ac8-86cd-5903cce7db03-kube-api-access-zcwrh\") pod \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " Jul 29 10:37:01.731747 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:01.731605 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23458eaa-1ca6-4ac8-86cd-5903cce7db03-model-cache\") pod \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\" (UID: \"23458eaa-1ca6-4ac8-86cd-5903cce7db03\") " Jul 29 10:37:01.733661 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:01.733633 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23458eaa-1ca6-4ac8-86cd-5903cce7db03-kube-api-access-zcwrh" (OuterVolumeSpecName: "kube-api-access-zcwrh") pod "23458eaa-1ca6-4ac8-86cd-5903cce7db03" (UID: "23458eaa-1ca6-4ac8-86cd-5903cce7db03"). InnerVolumeSpecName "kube-api-access-zcwrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:37:01.750667 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:01.750622 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23458eaa-1ca6-4ac8-86cd-5903cce7db03-model-cache" (OuterVolumeSpecName: "model-cache") pod "23458eaa-1ca6-4ac8-86cd-5903cce7db03" (UID: "23458eaa-1ca6-4ac8-86cd-5903cce7db03"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:37:01.832238 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:01.832206 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23458eaa-1ca6-4ac8-86cd-5903cce7db03-model-cache\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:37:01.832238 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:01.832235 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcwrh\" (UniqueName: \"kubernetes.io/projected/23458eaa-1ca6-4ac8-86cd-5903cce7db03-kube-api-access-zcwrh\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:37:02.478000 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:02.477970 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2r7k7" event={"ID":"23458eaa-1ca6-4ac8-86cd-5903cce7db03","Type":"ContainerDied","Data":"f587b844b36486d992d9a2384058308724a5c2087716dcddeed5c19aea7cd1d0"} Jul 29 10:37:02.478000 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:02.477995 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2r7k7" Jul 29 10:37:02.478000 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:02.478007 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f587b844b36486d992d9a2384058308724a5c2087716dcddeed5c19aea7cd1d0" Jul 29 10:37:14.669450 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.669416 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6"] Jul 29 10:37:14.669956 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.669912 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23458eaa-1ca6-4ac8-86cd-5903cce7db03" containerName="s3-init" Jul 29 10:37:14.669956 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.669931 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23458eaa-1ca6-4ac8-86cd-5903cce7db03" containerName="s3-init" Jul 29 10:37:14.669956 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.669952 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23458eaa-1ca6-4ac8-86cd-5903cce7db03" containerName="download-hf-model" Jul 29 10:37:14.670139 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.669962 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23458eaa-1ca6-4ac8-86cd-5903cce7db03" containerName="download-hf-model" Jul 29 10:37:14.670139 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.670048 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="23458eaa-1ca6-4ac8-86cd-5903cce7db03" containerName="s3-init" Jul 29 10:37:14.673467 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.673444 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.676960 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.676937 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 29 10:37:14.677063 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.676975 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 29 10:37:14.677063 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.676995 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 29 10:37:14.677063 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.677029 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 29 10:37:14.678356 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.678325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fqxzr\"" Jul 29 10:37:14.678461 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.678387 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 29 10:37:14.678461 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.678385 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 29 10:37:14.684836 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.684814 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6"] Jul 29 10:37:14.721452 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.721425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.721549 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.721460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qww\" (UniqueName: \"kubernetes.io/projected/0c4f1a56-ad37-4199-8770-34038a003753-kube-api-access-t9qww\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.721549 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.721482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.721677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.721553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.721677 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.721630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0c4f1a56-ad37-4199-8770-34038a003753-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.822577 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.822543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.822730 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.822584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qww\" (UniqueName: \"kubernetes.io/projected/0c4f1a56-ad37-4199-8770-34038a003753-kube-api-access-t9qww\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.822730 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.822608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.822730 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.822633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.822730 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.822678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0c4f1a56-ad37-4199-8770-34038a003753-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.822730 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:37:14.822685 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jul 29 10:37:14.823002 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:37:14.822756 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls podName:0c4f1a56-ad37-4199-8770-34038a003753 nodeName:}" failed. No retries permitted until 2026-07-29 10:37:15.322733796 +0000 UTC m=+529.412626759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls") pod "isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" (UID: "0c4f1a56-ad37-4199-8770-34038a003753") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jul 29 10:37:14.823095 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.823076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0c4f1a56-ad37-4199-8770-34038a003753-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.823302 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.823281 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.823426 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.823407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.834766 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.834743 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qww\" (UniqueName: \"kubernetes.io/projected/0c4f1a56-ad37-4199-8770-34038a003753-kube-api-access-t9qww\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:14.948724 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.948656 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf"] Jul 29 10:37:14.952236 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.952218 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:14.955697 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.955680 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 29 10:37:14.955961 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.955947 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 29 10:37:14.966109 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:14.966087 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf"] Jul 29 10:37:15.024235 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.024208 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.024372 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.024273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.024372 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.024309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7vfr\" (UniqueName: \"kubernetes.io/projected/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-api-access-c7vfr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.024372 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.024326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.024372 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.024348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125027 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.124998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7vfr\" (UniqueName: \"kubernetes.io/projected/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-api-access-c7vfr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125198 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.125037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125198 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.125057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125198 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.125095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125198 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.125146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125383 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:37:15.125253 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found Jul 29 10:37:15.125383 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:37:15.125313 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls podName:d78a258f-b209-4002-94d0-57b4ad8a3ad7 nodeName:}" failed. No retries permitted until 2026-07-29 10:37:15.625293006 +0000 UTC m=+529.715185960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-rqkpf" (UID: "d78a258f-b209-4002-94d0-57b4ad8a3ad7") : secret "isvc-xgboost-graph-predictor-serving-cert" not found Jul 29 10:37:15.125535 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.125512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125765 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.125750 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.125849 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.125831 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.136725 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.136702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7vfr\" (UniqueName: \"kubernetes.io/projected/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-api-access-c7vfr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.326620 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.326589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:15.329016 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.328991 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:15.583823 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.583734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:15.630026 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.629990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:15.630171 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:37:15.630137 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found Jul 29 10:37:15.630222 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:37:15.630214 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls podName:d78a258f-b209-4002-94d0-57b4ad8a3ad7 nodeName:}" failed. No retries permitted until 2026-07-29 10:37:16.630198674 +0000 UTC m=+530.720091630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-rqkpf" (UID: "d78a258f-b209-4002-94d0-57b4ad8a3ad7") : secret "isvc-xgboost-graph-predictor-serving-cert" not found Jul 29 10:37:15.711814 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:15.711793 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6"] Jul 29 10:37:15.714118 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:37:15.714094 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4f1a56_ad37_4199_8770_34038a003753.slice/crio-44ab9cb1b7b9bdca252c7002dedab7993318039b01948cc643af5aec8604d9e1 WatchSource:0}: Error finding container 44ab9cb1b7b9bdca252c7002dedab7993318039b01948cc643af5aec8604d9e1: Status 404 returned error can't find the container with id 44ab9cb1b7b9bdca252c7002dedab7993318039b01948cc643af5aec8604d9e1 Jul 29 10:37:16.530257 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:16.530218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerStarted","Data":"3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82"} Jul 29 10:37:16.530428 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:16.530291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerStarted","Data":"44ab9cb1b7b9bdca252c7002dedab7993318039b01948cc643af5aec8604d9e1"} Jul 29 10:37:16.639371 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:16.639336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:16.641751 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:16.641725 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-rqkpf\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:16.761896 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:16.761852 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:16.889076 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:16.889051 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf"] Jul 29 10:37:16.890982 ip-10-0-137-188 kubenswrapper[2580]: W0729 10:37:16.890955 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78a258f_b209_4002_94d0_57b4ad8a3ad7.slice/crio-81a449c9f43005b50940f76fa6eccc76a0700dd328d669bd0b4fe16761d954db WatchSource:0}: Error finding container 81a449c9f43005b50940f76fa6eccc76a0700dd328d669bd0b4fe16761d954db: Status 404 returned error can't find the container with id 81a449c9f43005b50940f76fa6eccc76a0700dd328d669bd0b4fe16761d954db Jul 29 10:37:17.536874 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:17.536830 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerStarted","Data":"0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c"} Jul 29 10:37:17.537053 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:17.536904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerStarted","Data":"81a449c9f43005b50940f76fa6eccc76a0700dd328d669bd0b4fe16761d954db"} Jul 29 10:37:20.550123 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:20.550092 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c4f1a56-ad37-4199-8770-34038a003753" containerID="3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82" exitCode=0 Jul 29 10:37:20.550489 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:20.550163 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerDied","Data":"3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82"} Jul 29 10:37:21.561275 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:21.561238 2580 generic.go:356] "Generic (PLEG): container finished" podID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerID="0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c" exitCode=0 Jul 29 10:37:21.561733 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:21.561364 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerDied","Data":"0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c"} Jul 29 10:37:45.702233 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:45.702003 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerStarted","Data":"7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513"} Jul 29 10:37:45.705183 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:45.705088 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerStarted","Data":"ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba"} Jul 29 10:37:48.720369 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.720336 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerStarted","Data":"ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863"} Jul 29 10:37:48.720818 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.720407 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:48.720818 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.720514 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:48.722134 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.722100 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:37:48.722504 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.722485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerStarted","Data":"0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f"} Jul 29 10:37:48.722630 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.722615 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:48.743375 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.743327 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podStartSLOduration=4.700830562 podStartE2EDuration="34.743312596s" totalImagesPullingTime="26.325106209s" totalInitContainerRuntime="3.717375825s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:37:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:37:48.742669906 +0000 UTC m=+562.832562888" watchObservedRunningTime="2026-07-29 10:37:48.743312596 +0000 UTC m=+562.833205572" Jul 29 10:37:48.767127 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:48.767076 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podStartSLOduration=3.7277576359999998 podStartE2EDuration="34.767059647s" totalImagesPullingTime="27.217412622s" totalInitContainerRuntime="3.821889389s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:37:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:37:48.765469648 +0000 UTC m=+562.855362626" watchObservedRunningTime="2026-07-29 10:37:48.767059647 +0000 UTC m=+562.856952623" Jul 29 10:37:49.726826 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:49.726790 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:49.727287 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:49.726976 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:37:49.727892 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:49.727849 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:37:50.730150 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:50.730112 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:37:54.731044 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:54.731016 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:37:54.731668 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:54.731640 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:37:55.735209 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:55.735183 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:37:55.735734 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:37:55.735707 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:38:04.732033 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:04.731940 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:38:05.736244 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:05.736204 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:38:14.732001 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:14.731965 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:38:15.736115 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:15.736073 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:38:24.732138 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:24.732095 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:38:25.736629 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:25.736592 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:38:26.343808 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:26.343777 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:38:26.349933 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:26.349906 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:38:34.731553 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:34.731515 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:38:35.736388 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:35.736342 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:38:44.732528 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:44.732486 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 29 10:38:45.736567 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:45.736534 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:38:54.732904 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:54.732817 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:38:55.736120 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:55.736078 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:38:56.456877 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:38:56.456832 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:39:06.459658 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:06.459627 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:39:44.792206 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:44.792173 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf"] Jul 29 10:39:44.792757 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:44.792414 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" containerID="cri-o://7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513" gracePeriod=30 Jul 29 10:39:44.792757 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:44.792455 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kube-rbac-proxy" containerID="cri-o://ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863" gracePeriod=30 Jul 29 10:39:44.905641 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:44.905605 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6"] Jul 29 10:39:44.905917 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:44.905886 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" containerID="cri-o://ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba" gracePeriod=30 Jul 29 10:39:44.906041 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:44.905908 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kube-rbac-proxy" containerID="cri-o://0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f" gracePeriod=30 Jul 29 10:39:45.177838 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:45.177747 2580 generic.go:356] "Generic (PLEG): container finished" podID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerID="ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863" exitCode=2 Jul 29 10:39:45.177838 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:45.177818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerDied","Data":"ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863"} Jul 29 10:39:45.180148 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:45.180122 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c4f1a56-ad37-4199-8770-34038a003753" containerID="0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f" exitCode=2 Jul 29 10:39:45.180259 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:45.180166 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerDied","Data":"0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f"} Jul 29 10:39:45.730427 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:45.730382 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Jul 29 10:39:46.457019 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:46.456974 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Jul 29 10:39:48.441639 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.441616 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:39:48.637030 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.636946 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls\") pod \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " Jul 29 10:39:48.637030 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.636995 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kserve-provision-location\") pod \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " Jul 29 10:39:48.637224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.637040 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-cabundle-cert\") pod \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " Jul 29 10:39:48.637224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.637072 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7vfr\" (UniqueName: \"kubernetes.io/projected/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-api-access-c7vfr\") pod \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " Jul 29 10:39:48.637224 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.637109 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-rbac-proxy-sar-config\") pod \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\" (UID: \"d78a258f-b209-4002-94d0-57b4ad8a3ad7\") " Jul 29 10:39:48.637409 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.637382 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d78a258f-b209-4002-94d0-57b4ad8a3ad7" (UID: "d78a258f-b209-4002-94d0-57b4ad8a3ad7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:39:48.637485 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.637458 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d78a258f-b209-4002-94d0-57b4ad8a3ad7" (UID: "d78a258f-b209-4002-94d0-57b4ad8a3ad7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:39:48.637592 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.637477 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d78a258f-b209-4002-94d0-57b4ad8a3ad7" (UID: "d78a258f-b209-4002-94d0-57b4ad8a3ad7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:39:48.639249 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.639226 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d78a258f-b209-4002-94d0-57b4ad8a3ad7" (UID: "d78a258f-b209-4002-94d0-57b4ad8a3ad7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:39:48.639377 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.639351 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-api-access-c7vfr" (OuterVolumeSpecName: "kube-api-access-c7vfr") pod "d78a258f-b209-4002-94d0-57b4ad8a3ad7" (UID: "d78a258f-b209-4002-94d0-57b4ad8a3ad7"). InnerVolumeSpecName "kube-api-access-c7vfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:39:48.738244 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.738209 2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-cabundle-cert\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:48.738244 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.738238 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7vfr\" (UniqueName: \"kubernetes.io/projected/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-api-access-c7vfr\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:48.738244 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.738248 2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:48.738468 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.738257 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d78a258f-b209-4002-94d0-57b4ad8a3ad7-proxy-tls\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:48.738468 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:48.738266 2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d78a258f-b209-4002-94d0-57b4ad8a3ad7-kserve-provision-location\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:49.199220 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.199181 2580 generic.go:356] "Generic (PLEG): container finished" podID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerID="7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513" exitCode=0 Jul 29 10:39:49.199384 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.199245 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" Jul 29 10:39:49.199384 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.199272 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerDied","Data":"7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513"} Jul 29 10:39:49.199384 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.199333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf" event={"ID":"d78a258f-b209-4002-94d0-57b4ad8a3ad7","Type":"ContainerDied","Data":"81a449c9f43005b50940f76fa6eccc76a0700dd328d669bd0b4fe16761d954db"} Jul 29 10:39:49.199384 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.199362 2580 scope.go:117] "RemoveContainer" containerID="ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863" Jul 29 10:39:49.208306 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.208288 2580 scope.go:117] "RemoveContainer" containerID="7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513" Jul 29 10:39:49.215568 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.215550 2580 scope.go:117] "RemoveContainer" containerID="0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c" Jul 29 10:39:49.222747 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.222722 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf"] Jul 29 10:39:49.223172 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.223155 2580 scope.go:117] "RemoveContainer" containerID="ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863" Jul 29 10:39:49.223421 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:39:49.223400 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863\": container with ID starting with ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863 not found: ID does not exist" containerID="ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863" Jul 29 10:39:49.223487 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.223445 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863"} err="failed to get container status \"ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863\": rpc error: code = NotFound desc = could not find container \"ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863\": container with ID starting with ac8c90b1506f836d324df489dd5b4c0ec6ccaeef5e6209fc70cbb8a9be412863 not found: ID does not exist" Jul 29 10:39:49.223487 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.223473 2580 scope.go:117] "RemoveContainer" containerID="7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513" Jul 29 10:39:49.223716 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:39:49.223697 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513\": container with ID starting with 7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513 not found: ID does not exist" containerID="7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513" Jul 29 10:39:49.223755 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.223724 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513"} err="failed to get container status \"7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513\": rpc error: code = NotFound desc = could not find container \"7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513\": container with ID starting with 7b82573724bd95c12642d372970132d8afe1930e0b88475ecdaef202bfa0b513 not found: ID does not exist" Jul 29 10:39:49.223755 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.223739 2580 scope.go:117] "RemoveContainer" containerID="0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c" Jul 29 10:39:49.223963 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:39:49.223945 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c\": container with ID starting with 0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c not found: ID does not exist" containerID="0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c" Jul 29 10:39:49.224014 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.223970 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c"} err="failed to get container status \"0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c\": rpc error: code = NotFound desc = could not find container \"0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c\": container with ID starting with 0e7e3d44f24a544bdb1eabe73630fe4c6a13e1e32bd07dfaeafff824622e132c not found: ID does not exist" Jul 29 10:39:49.227584 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.227563 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-rqkpf"] Jul 29 10:39:49.656751 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.656728 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:39:49.745220 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745145 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls\") pod \"0c4f1a56-ad37-4199-8770-34038a003753\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " Jul 29 10:39:49.745220 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745197 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-kube-rbac-proxy-sar-config\") pod \"0c4f1a56-ad37-4199-8770-34038a003753\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " Jul 29 10:39:49.745433 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745230 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9qww\" (UniqueName: \"kubernetes.io/projected/0c4f1a56-ad37-4199-8770-34038a003753-kube-api-access-t9qww\") pod \"0c4f1a56-ad37-4199-8770-34038a003753\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " Jul 29 10:39:49.745433 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745269 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-cabundle-cert\") pod \"0c4f1a56-ad37-4199-8770-34038a003753\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " Jul 29 10:39:49.745433 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745306 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0c4f1a56-ad37-4199-8770-34038a003753-kserve-provision-location\") pod \"0c4f1a56-ad37-4199-8770-34038a003753\" (UID: \"0c4f1a56-ad37-4199-8770-34038a003753\") " Jul 29 10:39:49.745744 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745713 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "0c4f1a56-ad37-4199-8770-34038a003753" (UID: "0c4f1a56-ad37-4199-8770-34038a003753"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:39:49.745744 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745735 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4f1a56-ad37-4199-8770-34038a003753-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "0c4f1a56-ad37-4199-8770-34038a003753" (UID: "0c4f1a56-ad37-4199-8770-34038a003753"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:39:49.745962 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.745710 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "0c4f1a56-ad37-4199-8770-34038a003753" (UID: "0c4f1a56-ad37-4199-8770-34038a003753"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:39:49.747433 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.747406 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4f1a56-ad37-4199-8770-34038a003753-kube-api-access-t9qww" (OuterVolumeSpecName: "kube-api-access-t9qww") pod "0c4f1a56-ad37-4199-8770-34038a003753" (UID: "0c4f1a56-ad37-4199-8770-34038a003753"). InnerVolumeSpecName "kube-api-access-t9qww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:39:49.747523 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.747410 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0c4f1a56-ad37-4199-8770-34038a003753" (UID: "0c4f1a56-ad37-4199-8770-34038a003753"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:39:49.846307 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.846267 2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:49.846307 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.846299 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9qww\" (UniqueName: \"kubernetes.io/projected/0c4f1a56-ad37-4199-8770-34038a003753-kube-api-access-t9qww\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:49.846307 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.846309 2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0c4f1a56-ad37-4199-8770-34038a003753-cabundle-cert\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:49.846535 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.846319 2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0c4f1a56-ad37-4199-8770-34038a003753-kserve-provision-location\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:49.846535 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:49.846328 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0c4f1a56-ad37-4199-8770-34038a003753-proxy-tls\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 10:39:50.205575 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.205534 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c4f1a56-ad37-4199-8770-34038a003753" containerID="ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba" exitCode=0 Jul 29 10:39:50.205742 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.205598 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" Jul 29 10:39:50.205742 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.205617 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerDied","Data":"ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba"} Jul 29 10:39:50.205742 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.205686 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6" event={"ID":"0c4f1a56-ad37-4199-8770-34038a003753","Type":"ContainerDied","Data":"44ab9cb1b7b9bdca252c7002dedab7993318039b01948cc643af5aec8604d9e1"} Jul 29 10:39:50.205742 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.205727 2580 scope.go:117] "RemoveContainer" containerID="0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f" Jul 29 10:39:50.214458 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.214441 2580 scope.go:117] "RemoveContainer" containerID="ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba" Jul 29 10:39:50.221758 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.221739 2580 scope.go:117] "RemoveContainer" containerID="3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82" Jul 29 10:39:50.229272 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.229253 2580 scope.go:117] "RemoveContainer" containerID="0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f" Jul 29 10:39:50.229547 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:39:50.229523 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f\": container with ID starting with 0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f not found: ID does not exist" containerID="0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f" Jul 29 10:39:50.229631 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.229564 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f"} err="failed to get container status \"0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f\": rpc error: code = NotFound desc = could not find container \"0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f\": container with ID starting with 0d342061a9b3ed467e83f563af031b9a9ed7aa6eb815a54effbbbfc8e693847f not found: ID does not exist" Jul 29 10:39:50.229631 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.229586 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6"] Jul 29 10:39:50.229631 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.229591 2580 scope.go:117] "RemoveContainer" containerID="ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba" Jul 29 10:39:50.229868 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:39:50.229836 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba\": container with ID starting with ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba not found: ID does not exist" containerID="ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba" Jul 29 10:39:50.229913 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.229880 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba"} err="failed to get container status \"ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba\": rpc error: code = NotFound desc = could not find container \"ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba\": container with ID starting with ef18ece51f4f4bab7315de6cc032a2e7d9faca330eced51fb34d953b9dfd76ba not found: ID does not exist" Jul 29 10:39:50.229913 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.229899 2580 scope.go:117] "RemoveContainer" containerID="3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82" Jul 29 10:39:50.230122 ip-10-0-137-188 kubenswrapper[2580]: E0729 10:39:50.230105 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82\": container with ID starting with 3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82 not found: ID does not exist" containerID="3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82" Jul 29 10:39:50.230165 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.230125 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82"} err="failed to get container status \"3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82\": rpc error: code = NotFound desc = could not find container \"3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82\": container with ID starting with 3cd8c694c1582fe39f8d031247026a4beb82e4e7a1aeb5ec32b0d7d828cd1c82 not found: ID does not exist" Jul 29 10:39:50.233006 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.232976 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-65bbfc86dd-2qcj6"] Jul 29 10:39:50.459175 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.459100 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c4f1a56-ad37-4199-8770-34038a003753" path="/var/lib/kubelet/pods/0c4f1a56-ad37-4199-8770-34038a003753/volumes" Jul 29 10:39:50.459589 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:39:50.459576 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" path="/var/lib/kubelet/pods/d78a258f-b209-4002-94d0-57b4ad8a3ad7/volumes" Jul 29 10:43:26.370558 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:43:26.370485 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:43:26.373200 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:43:26.373176 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:48:26.402285 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:48:26.402240 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:48:26.402875 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:48:26.402421 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:53:26.425683 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:53:26.425652 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:53:26.428320 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:53:26.426362 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:58:26.448720 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:58:26.448590 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 10:58:26.454930 ip-10-0-137-188 kubenswrapper[2580]: I0729 10:58:26.451014 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:03:26.473910 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:03:26.473780 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:03:26.477225 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:03:26.476343 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:08:26.497071 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:08:26.496962 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:08:26.501337 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:08:26.501309 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:13:26.520673 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:13:26.520564 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:13:26.525235 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:13:26.525215 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:16:46.149184 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149096 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4lxc5/must-gather-jphtn"] Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149383 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149394 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149406 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kube-rbac-proxy" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149412 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kube-rbac-proxy" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149427 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="storage-initializer" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149433 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="storage-initializer" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149445 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149450 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149458 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kube-rbac-proxy" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149463 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kube-rbac-proxy" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149470 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="storage-initializer" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149475 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="storage-initializer" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149517 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kserve-container" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149525 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kube-rbac-proxy" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149532 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d78a258f-b209-4002-94d0-57b4ad8a3ad7" containerName="kserve-container" Jul 29 11:16:46.149632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.149538 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4f1a56-ad37-4199-8770-34038a003753" containerName="kube-rbac-proxy" Jul 29 11:16:46.152669 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.152649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.156058 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.156035 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4lxc5\"/\"default-dockercfg-vbqqv\"" Jul 29 11:16:46.156837 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.156814 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4lxc5\"/\"openshift-service-ca.crt\"" Jul 29 11:16:46.156973 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.156924 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4lxc5\"/\"kube-root-ca.crt\"" Jul 29 11:16:46.171675 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.171651 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lxc5/must-gather-jphtn"] Jul 29 11:16:46.187525 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.187503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41d235f7-b015-4ac5-a3ee-423455616945-must-gather-output\") pod \"must-gather-jphtn\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.187658 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.187537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2btfj\" (UniqueName: \"kubernetes.io/projected/41d235f7-b015-4ac5-a3ee-423455616945-kube-api-access-2btfj\") pod \"must-gather-jphtn\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.288887 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.288836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41d235f7-b015-4ac5-a3ee-423455616945-must-gather-output\") pod \"must-gather-jphtn\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.289054 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.288918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2btfj\" (UniqueName: \"kubernetes.io/projected/41d235f7-b015-4ac5-a3ee-423455616945-kube-api-access-2btfj\") pod \"must-gather-jphtn\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.289193 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.289175 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41d235f7-b015-4ac5-a3ee-423455616945-must-gather-output\") pod \"must-gather-jphtn\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.296844 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.296820 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2btfj\" (UniqueName: \"kubernetes.io/projected/41d235f7-b015-4ac5-a3ee-423455616945-kube-api-access-2btfj\") pod \"must-gather-jphtn\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.461023 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.460945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:16:46.599590 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.599410 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lxc5/must-gather-jphtn"] Jul 29 11:16:46.601805 ip-10-0-137-188 kubenswrapper[2580]: W0729 11:16:46.601774 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41d235f7_b015_4ac5_a3ee_423455616945.slice/crio-ebc576c8dc1d9fbedcd3fe46ea6c07d86e214edfef4029845d149b16c6c1b5e4 WatchSource:0}: Error finding container ebc576c8dc1d9fbedcd3fe46ea6c07d86e214edfef4029845d149b16c6c1b5e4: Status 404 returned error can't find the container with id ebc576c8dc1d9fbedcd3fe46ea6c07d86e214edfef4029845d149b16c6c1b5e4 Jul 29 11:16:46.603536 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:46.603517 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 11:16:47.530737 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:47.530701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxc5/must-gather-jphtn" event={"ID":"41d235f7-b015-4ac5-a3ee-423455616945","Type":"ContainerStarted","Data":"ebc576c8dc1d9fbedcd3fe46ea6c07d86e214edfef4029845d149b16c6c1b5e4"} Jul 29 11:16:54.566340 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:54.566290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxc5/must-gather-jphtn" event={"ID":"41d235f7-b015-4ac5-a3ee-423455616945","Type":"ContainerStarted","Data":"7deef0ba4029f1249453ec28c12551506401c6ef95d12de057a855500d42ad91"} Jul 29 11:16:54.566908 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:54.566353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxc5/must-gather-jphtn" event={"ID":"41d235f7-b015-4ac5-a3ee-423455616945","Type":"ContainerStarted","Data":"32c08f61a79044e62b1ee9bfd300c5a9d39c8b08d7a60ae0b9a1682bd4d3f3a8"} Jul 29 11:16:54.587476 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:16:54.587424 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4lxc5/must-gather-jphtn" podStartSLOduration=1.6859422450000001 podStartE2EDuration="8.587409024s" totalImagesPullingTime="6.901466779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 11:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:16:54.585754355 +0000 UTC m=+2908.675647331" watchObservedRunningTime="2026-07-29 11:16:54.587409024 +0000 UTC m=+2908.677302001" Jul 29 11:17:16.666299 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:16.666264 2580 generic.go:356] "Generic (PLEG): container finished" podID="41d235f7-b015-4ac5-a3ee-423455616945" containerID="32c08f61a79044e62b1ee9bfd300c5a9d39c8b08d7a60ae0b9a1682bd4d3f3a8" exitCode=0 Jul 29 11:17:16.666793 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:16.666334 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxc5/must-gather-jphtn" event={"ID":"41d235f7-b015-4ac5-a3ee-423455616945","Type":"ContainerDied","Data":"32c08f61a79044e62b1ee9bfd300c5a9d39c8b08d7a60ae0b9a1682bd4d3f3a8"} Jul 29 11:17:16.666793 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:16.666682 2580 scope.go:117] "RemoveContainer" containerID="32c08f61a79044e62b1ee9bfd300c5a9d39c8b08d7a60ae0b9a1682bd4d3f3a8" Jul 29 11:17:17.095950 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:17.095915 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4lxc5_must-gather-jphtn_41d235f7-b015-4ac5-a3ee-423455616945/gather/0.log" Jul 29 11:17:22.030377 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.030304 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-spzhb_27fd048a-2b59-4ba1-9ae4-a46f2f8a622a/global-pull-secret-syncer/0.log" Jul 29 11:17:22.225953 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.225921 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-slrcg_bdd860fb-acf4-424b-92e2-518fba7c751b/konnectivity-agent/0.log" Jul 29 11:17:22.285219 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.285152 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-188.ec2.internal_9fe3d4c265d9deaaa9b093db00714d9f/haproxy/0.log" Jul 29 11:17:22.548119 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.548033 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-4lxc5/must-gather-jphtn"] Jul 29 11:17:22.548333 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.548305 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-4lxc5/must-gather-jphtn" podUID="41d235f7-b015-4ac5-a3ee-423455616945" containerName="copy" containerID="cri-o://7deef0ba4029f1249453ec28c12551506401c6ef95d12de057a855500d42ad91" gracePeriod=2 Jul 29 11:17:22.550201 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.550178 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-4lxc5/must-gather-jphtn"] Jul 29 11:17:22.551005 ip-10-0-137-188 kubenswrapper[2580]: E0729 11:17:22.550975 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jphtn\" is forbidden: User \"system:node:ip-10-0-137-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4lxc5\": no relationship found between node 'ip-10-0-137-188.ec2.internal' and this object" podUID="41d235f7-b015-4ac5-a3ee-423455616945" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:17:22.691944 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.691920 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4lxc5_must-gather-jphtn_41d235f7-b015-4ac5-a3ee-423455616945/copy/0.log" Jul 29 11:17:22.692334 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.692312 2580 generic.go:356] "Generic (PLEG): container finished" podID="41d235f7-b015-4ac5-a3ee-423455616945" containerID="7deef0ba4029f1249453ec28c12551506401c6ef95d12de057a855500d42ad91" exitCode=143 Jul 29 11:17:22.773344 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.773316 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4lxc5_must-gather-jphtn_41d235f7-b015-4ac5-a3ee-423455616945/copy/0.log" Jul 29 11:17:22.775839 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.775820 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:17:22.778390 ip-10-0-137-188 kubenswrapper[2580]: E0729 11:17:22.778366 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jphtn\" is forbidden: User \"system:node:ip-10-0-137-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4lxc5\": no relationship found between node 'ip-10-0-137-188.ec2.internal' and this object" podUID="41d235f7-b015-4ac5-a3ee-423455616945" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:17:22.917464 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.917385 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2btfj\" (UniqueName: \"kubernetes.io/projected/41d235f7-b015-4ac5-a3ee-423455616945-kube-api-access-2btfj\") pod \"41d235f7-b015-4ac5-a3ee-423455616945\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " Jul 29 11:17:22.917464 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.917428 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41d235f7-b015-4ac5-a3ee-423455616945-must-gather-output\") pod \"41d235f7-b015-4ac5-a3ee-423455616945\" (UID: \"41d235f7-b015-4ac5-a3ee-423455616945\") " Jul 29 11:17:22.919132 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.919107 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d235f7-b015-4ac5-a3ee-423455616945-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "41d235f7-b015-4ac5-a3ee-423455616945" (UID: "41d235f7-b015-4ac5-a3ee-423455616945"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 11:17:22.919588 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:22.919565 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d235f7-b015-4ac5-a3ee-423455616945-kube-api-access-2btfj" (OuterVolumeSpecName: "kube-api-access-2btfj") pod "41d235f7-b015-4ac5-a3ee-423455616945" (UID: "41d235f7-b015-4ac5-a3ee-423455616945"). InnerVolumeSpecName "kube-api-access-2btfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 11:17:23.017959 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:23.017929 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2btfj\" (UniqueName: \"kubernetes.io/projected/41d235f7-b015-4ac5-a3ee-423455616945-kube-api-access-2btfj\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 11:17:23.017959 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:23.017956 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41d235f7-b015-4ac5-a3ee-423455616945-must-gather-output\") on node \"ip-10-0-137-188.ec2.internal\" DevicePath \"\"" Jul 29 11:17:23.697148 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:23.697120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4lxc5_must-gather-jphtn_41d235f7-b015-4ac5-a3ee-423455616945/copy/0.log" Jul 29 11:17:23.697563 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:23.697547 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:17:23.697650 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:23.697554 2580 scope.go:117] "RemoveContainer" containerID="7deef0ba4029f1249453ec28c12551506401c6ef95d12de057a855500d42ad91" Jul 29 11:17:23.700454 ip-10-0-137-188 kubenswrapper[2580]: E0729 11:17:23.700429 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jphtn\" is forbidden: User \"system:node:ip-10-0-137-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4lxc5\": no relationship found between node 'ip-10-0-137-188.ec2.internal' and this object" podUID="41d235f7-b015-4ac5-a3ee-423455616945" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:17:23.705518 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:23.705329 2580 scope.go:117] "RemoveContainer" containerID="32c08f61a79044e62b1ee9bfd300c5a9d39c8b08d7a60ae0b9a1682bd4d3f3a8" Jul 29 11:17:23.708432 ip-10-0-137-188 kubenswrapper[2580]: E0729 11:17:23.708407 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jphtn\" is forbidden: User \"system:node:ip-10-0-137-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4lxc5\": no relationship found between node 'ip-10-0-137-188.ec2.internal' and this object" podUID="41d235f7-b015-4ac5-a3ee-423455616945" pod="openshift-must-gather-4lxc5/must-gather-jphtn" Jul 29 11:17:24.459469 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:24.459436 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d235f7-b015-4ac5-a3ee-423455616945" path="/var/lib/kubelet/pods/41d235f7-b015-4ac5-a3ee-423455616945/volumes" Jul 29 11:17:26.324166 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:26.324112 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/1.log" Jul 29 11:17:26.481054 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:26.480957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hp29z_20303846-8a86-4ecd-a03d-9f1104dd04d7/cluster-monitoring-operator/0.log" Jul 29 11:17:26.681224 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:26.681195 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9975_a38d9390-1ee1-4a1b-a963-5ea539a323e1/node-exporter/0.log" Jul 29 11:17:26.712842 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:26.712815 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9975_a38d9390-1ee1-4a1b-a963-5ea539a323e1/kube-rbac-proxy/0.log" Jul 29 11:17:26.740151 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:26.740127 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9975_a38d9390-1ee1-4a1b-a963-5ea539a323e1/init-textfile/0.log" Jul 29 11:17:26.981923 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:26.981893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qkgj6_a473886a-203b-46db-b02d-9da94b869510/kube-rbac-proxy-main/0.log" Jul 29 11:17:27.008015 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.007938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qkgj6_a473886a-203b-46db-b02d-9da94b869510/kube-rbac-proxy-self/0.log" Jul 29 11:17:27.036665 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.036644 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qkgj6_a473886a-203b-46db-b02d-9da94b869510/openshift-state-metrics/0.log" Jul 29 11:17:27.087471 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.087442 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_998776db-7b4a-470c-aa5d-e484635e1ee9/prometheus/0.log" Jul 29 11:17:27.109880 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.109836 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_998776db-7b4a-470c-aa5d-e484635e1ee9/config-reloader/0.log" Jul 29 11:17:27.137192 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.137160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_998776db-7b4a-470c-aa5d-e484635e1ee9/thanos-sidecar/0.log" Jul 29 11:17:27.163434 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.163410 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_998776db-7b4a-470c-aa5d-e484635e1ee9/kube-rbac-proxy-web/0.log" Jul 29 11:17:27.191000 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.190973 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_998776db-7b4a-470c-aa5d-e484635e1ee9/kube-rbac-proxy/0.log" Jul 29 11:17:27.217712 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.217685 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_998776db-7b4a-470c-aa5d-e484635e1ee9/kube-rbac-proxy-thanos/0.log" Jul 29 11:17:27.246713 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.246685 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_998776db-7b4a-470c-aa5d-e484635e1ee9/init-config-reloader/0.log" Jul 29 11:17:27.288997 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.288955 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-2t65j_a27db542-f898-4d44-af7d-2691498fd1ec/prometheus-operator/0.log" Jul 29 11:17:27.308170 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.308146 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-2t65j_a27db542-f898-4d44-af7d-2691498fd1ec/kube-rbac-proxy/0.log" Jul 29 11:17:27.339177 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:27.339147 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-hlst6_1d17da0f-479c-4dcf-aaea-afd82e1dcbc8/prometheus-operator-admission-webhook/0.log" Jul 29 11:17:28.936718 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:28.936681 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-d6jzj_db8dc379-af2d-4150-b9c2-2e4cd1152d7d/networking-console-plugin/0.log" Jul 29 11:17:30.574678 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.574639 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb"] Jul 29 11:17:30.575189 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.575130 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d235f7-b015-4ac5-a3ee-423455616945" containerName="gather" Jul 29 11:17:30.575189 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.575151 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d235f7-b015-4ac5-a3ee-423455616945" containerName="gather" Jul 29 11:17:30.575189 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.575167 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d235f7-b015-4ac5-a3ee-423455616945" containerName="copy" Jul 29 11:17:30.575189 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.575175 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d235f7-b015-4ac5-a3ee-423455616945" containerName="copy" Jul 29 11:17:30.575396 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.575269 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d235f7-b015-4ac5-a3ee-423455616945" containerName="copy" Jul 29 11:17:30.575396 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.575287 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d235f7-b015-4ac5-a3ee-423455616945" containerName="gather" Jul 29 11:17:30.580559 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.580536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.583558 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.583534 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kqzn\"/\"openshift-service-ca.crt\"" Jul 29 11:17:30.585145 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.585124 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8kqzn\"/\"default-dockercfg-9wrc4\"" Jul 29 11:17:30.585257 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.585168 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kqzn\"/\"kube-root-ca.crt\"" Jul 29 11:17:30.587751 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.587735 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb"] Jul 29 11:17:30.677301 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.677273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-lib-modules\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.677458 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.677317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-podres\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.677458 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.677391 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9zt7\" (UniqueName: \"kubernetes.io/projected/d673a85e-8868-4e6d-8062-566396a78913-kube-api-access-s9zt7\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.677458 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.677432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-proc\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.677579 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.677468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-sys\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778005 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.777974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-proc\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778194 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-sys\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778194 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778121 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-proc\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778194 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778166 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-sys\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778323 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-lib-modules\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778323 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-podres\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778323 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9zt7\" (UniqueName: \"kubernetes.io/projected/d673a85e-8868-4e6d-8062-566396a78913-kube-api-access-s9zt7\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778466 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-lib-modules\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.778466 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.778385 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d673a85e-8868-4e6d-8062-566396a78913-podres\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.786763 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.786742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9zt7\" (UniqueName: \"kubernetes.io/projected/d673a85e-8868-4e6d-8062-566396a78913-kube-api-access-s9zt7\") pod \"perf-node-gather-daemonset-dzrfb\" (UID: \"d673a85e-8868-4e6d-8062-566396a78913\") " pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:30.891545 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:30.891461 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:31.021646 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.021611 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb"] Jul 29 11:17:31.024951 ip-10-0-137-188 kubenswrapper[2580]: W0729 11:17:31.024924 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd673a85e_8868_4e6d_8062_566396a78913.slice/crio-363ac9224df3e01d02c4a8ff9165374347754470cb2623ec1242e610f0208a66 WatchSource:0}: Error finding container 363ac9224df3e01d02c4a8ff9165374347754470cb2623ec1242e610f0208a66: Status 404 returned error can't find the container with id 363ac9224df3e01d02c4a8ff9165374347754470cb2623ec1242e610f0208a66 Jul 29 11:17:31.655044 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.655013 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlgwk_c683f5cd-2600-4422-bbb2-5ece4d87838a/dns/0.log" Jul 29 11:17:31.680451 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.680424 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlgwk_c683f5cd-2600-4422-bbb2-5ece4d87838a/kube-rbac-proxy/0.log" Jul 29 11:17:31.728675 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.728643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" event={"ID":"d673a85e-8868-4e6d-8062-566396a78913","Type":"ContainerStarted","Data":"55f611eef37a2a251e90a395be7915fa537284415ab96b8e915874de4e84c5d6"} Jul 29 11:17:31.728884 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.728697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" event={"ID":"d673a85e-8868-4e6d-8062-566396a78913","Type":"ContainerStarted","Data":"363ac9224df3e01d02c4a8ff9165374347754470cb2623ec1242e610f0208a66"} Jul 29 11:17:31.728884 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.728723 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:31.748548 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.748507 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" podStartSLOduration=1.748493595 podStartE2EDuration="1.748493595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 11:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 11:17:31.747759231 +0000 UTC m=+2945.837652209" watchObservedRunningTime="2026-07-29 11:17:31.748493595 +0000 UTC m=+2945.838386571" Jul 29 11:17:31.826079 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:31.826050 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vqwz_2ead0e0a-0209-4acd-9b7e-0d2a34e74c6f/dns-node-resolver/0.log" Jul 29 11:17:32.399162 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:32.399131 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j9rws_b950870a-55fa-47c1-bc20-91cfaee138f4/node-ca/0.log" Jul 29 11:17:33.249440 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:33.249408 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6898c89c69-xzjv2_f1a3923c-6923-48e6-8e7c-48cd9c73ed12/router/0.log" Jul 29 11:17:33.594605 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:33.594576 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4w6d_5fa68c7e-213d-4c6f-8cb4-afdb53a505f9/serve-healthcheck-canary/0.log" Jul 29 11:17:34.049044 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:34.049014 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-565pv_5bfffe02-f038-40e3-9087-d10b8b2ab39d/insights-operator/0.log" Jul 29 11:17:34.050091 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:34.050068 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-565pv_5bfffe02-f038-40e3-9087-d10b8b2ab39d/insights-operator/1.log" Jul 29 11:17:34.151831 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:34.151801 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d47bh_08581f27-cdbd-4cb2-855a-ee49a8a54925/kube-rbac-proxy/0.log" Jul 29 11:17:34.177152 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:34.177130 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d47bh_08581f27-cdbd-4cb2-855a-ee49a8a54925/exporter/0.log" Jul 29 11:17:34.202405 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:34.202379 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d47bh_08581f27-cdbd-4cb2-855a-ee49a8a54925/extractor/0.log" Jul 29 11:17:36.819428 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:36.819393 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-2r7k7_23458eaa-1ca6-4ac8-86cd-5903cce7db03/s3-init/0.log" Jul 29 11:17:36.838632 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:36.838601 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-2r7k7_23458eaa-1ca6-4ac8-86cd-5903cce7db03/download-hf-model/0.log" Jul 29 11:17:37.742388 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:37.742360 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8kqzn/perf-node-gather-daemonset-dzrfb" Jul 29 11:17:42.689936 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.689881 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-64p6z_022b842d-1c95-4199-8b1a-39a5ab456151/kube-multus/0.log" Jul 29 11:17:42.716026 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.715996 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ct4t_13c4ca7d-1f16-4cbb-a2ad-a1732995aea9/kube-multus-additional-cni-plugins/0.log" Jul 29 11:17:42.739924 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.739902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ct4t_13c4ca7d-1f16-4cbb-a2ad-a1732995aea9/egress-router-binary-copy/0.log" Jul 29 11:17:42.768344 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.768309 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ct4t_13c4ca7d-1f16-4cbb-a2ad-a1732995aea9/cni-plugins/0.log" Jul 29 11:17:42.792989 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.792957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ct4t_13c4ca7d-1f16-4cbb-a2ad-a1732995aea9/bond-cni-plugin/0.log" Jul 29 11:17:42.816932 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.816899 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ct4t_13c4ca7d-1f16-4cbb-a2ad-a1732995aea9/routeoverride-cni/0.log" Jul 29 11:17:42.842370 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.842345 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ct4t_13c4ca7d-1f16-4cbb-a2ad-a1732995aea9/whereabouts-cni-bincopy/0.log" Jul 29 11:17:42.866424 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:42.866396 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ct4t_13c4ca7d-1f16-4cbb-a2ad-a1732995aea9/whereabouts-cni/0.log" Jul 29 11:17:43.339872 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:43.339824 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ccg6m_768a1bdd-30a9-4097-8a09-c4b08dfac2d0/network-metrics-daemon/0.log" Jul 29 11:17:43.362622 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:43.362591 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ccg6m_768a1bdd-30a9-4097-8a09-c4b08dfac2d0/kube-rbac-proxy/0.log" Jul 29 11:17:44.798713 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:44.798676 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/ovn-controller/0.log" Jul 29 11:17:44.818298 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:44.818272 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/ovn-acl-logging/0.log" Jul 29 11:17:44.846094 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:44.846062 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/kube-rbac-proxy-node/0.log" Jul 29 11:17:44.873922 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:44.873895 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 11:17:44.897192 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:44.897152 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/northd/0.log" Jul 29 11:17:44.921563 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:44.921535 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/nbdb/0.log" Jul 29 11:17:44.945406 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:44.945381 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/sbdb/0.log" Jul 29 11:17:45.051952 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:45.051872 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64gmd_6787dcaa-5c70-413b-9414-acbc2483d422/ovnkube-controller/0.log" Jul 29 11:17:46.027538 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:46.027508 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-2pzw7_2aec7501-711c-4885-8a00-ac24d814018f/check-endpoints/0.log" Jul 29 11:17:46.085685 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:46.085651 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pk245_3c568fc3-c0c7-4837-8f6b-5ed6e5c49dad/network-check-target-container/0.log" Jul 29 11:17:47.070449 ip-10-0-137-188 kubenswrapper[2580]: I0729 11:17:47.070419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hjkqh_aed36b38-366f-4d21-9ce8-41a52305d78a/iptables-alerter/0.log"