Jul 27 16:48:47.919253 ip-10-0-141-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 16:48:47.919265 ip-10-0-141-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 16:48:47.919275 ip-10-0-141-8 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 16:48:47.919489 ip-10-0-141-8 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 16:48:58.009790 ip-10-0-141-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 16:48:58.009808 ip-10-0-141-8 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cb853bc87caf4490b47731b44b68b779 -- Jul 27 16:50:42.251124 ip-10-0-141-8 systemd[1]: Starting Kubernetes Kubelet... Jul 27 16:50:42.703361 ip-10-0-141-8 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:50:42.703361 ip-10-0-141-8 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 16:50:42.703361 ip-10-0-141-8 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:50:42.703361 ip-10-0-141-8 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 16:50:42.703361 ip-10-0-141-8 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:50:42.704038 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.703370 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 16:50:42.708897 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708881 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:50:42.708897 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708895 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:50:42.708897 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708899 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708903 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708906 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708909 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708911 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708914 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708917 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708919 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708922 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708925 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708927 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708930 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708932 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708935 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708939 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708941 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708944 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708946 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708952 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708956 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:50:42.708991 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708958 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708962 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708964 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708967 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708975 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708978 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708981 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708984 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708987 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708990 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708992 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708995 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.708998 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709001 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709004 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709007 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709009 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709013 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709015 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709018 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:50:42.709499 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709020 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709023 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709026 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709028 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709031 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709035 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709038 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709041 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709044 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709047 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709050 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709054 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709057 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709060 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709063 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709065 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709068 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709071 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709074 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:50:42.710008 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709076 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709079 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709081 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709084 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709087 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709089 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709092 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709094 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709097 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709100 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709102 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709105 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709108 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709110 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.709113 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710223 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710229 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710233 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710236 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710239 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:50:42.710478 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710242 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710247 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710251 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710254 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710257 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710268 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710271 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710274 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710277 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710280 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710283 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710286 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710289 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710292 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710297 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710300 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710303 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:50:42.710977 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.710306 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711020 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711027 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711030 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711033 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711036 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711039 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711042 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711045 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711047 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711051 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711054 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711057 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711060 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711062 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711065 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711067 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711071 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711073 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:50:42.711377 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711077 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711081 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711084 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711087 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711090 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711093 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711096 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711098 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711101 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711104 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711107 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711110 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711113 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711116 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711118 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711122 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711125 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711128 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711130 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711133 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:50:42.711846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711136 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711138 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711141 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711143 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711146 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711149 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711152 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711154 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711157 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711161 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711164 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711167 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711170 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711173 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711176 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711179 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711181 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711184 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711187 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711189 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:50:42.712329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711192 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711194 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711197 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711200 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711202 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711205 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711207 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711211 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711213 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711216 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711219 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711221 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711224 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711226 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711229 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711231 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711234 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711237 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711240 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711242 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:50:42.712807 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711246 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711249 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711251 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711254 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711256 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711259 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711261 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711264 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711267 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711270 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711273 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711276 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711279 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711281 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711284 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711286 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711289 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711292 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711294 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:50:42.713319 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711297 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711300 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711684 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711689 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711692 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711695 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711697 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711701 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711704 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711707 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711715 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711718 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711720 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711723 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711726 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711728 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711730 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711733 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711736 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711738 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:50:42.713768 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711741 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711744 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711746 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711748 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711751 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711754 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711756 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711759 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711761 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711764 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711767 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711769 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711772 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711775 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711777 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711780 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711782 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711785 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711787 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711790 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:50:42.714275 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711792 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711795 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711797 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711805 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711808 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711811 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711827 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711831 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711833 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711836 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711840 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711843 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711846 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711850 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711853 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711856 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711859 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711862 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711864 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:50:42.714791 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711867 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711871 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711873 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711876 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711878 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711881 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711884 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711887 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711889 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711892 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711894 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711897 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711899 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711902 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711905 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711907 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711909 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711918 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711921 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711923 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:50:42.715263 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711925 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711928 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711931 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711933 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711936 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711938 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711940 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711943 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711946 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711948 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711951 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711953 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711956 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711958 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711961 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711965 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711968 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711971 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711974 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:50:42.715738 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711977 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711979 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.711982 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712050 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712060 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712073 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712077 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712082 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712085 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712089 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712093 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712104 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712107 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712110 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712114 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712117 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712120 2582 flags.go:64] FLAG: --cgroup-root="" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712123 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712126 2582 flags.go:64] FLAG: --client-ca-file="" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712129 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712132 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712138 2582 flags.go:64] FLAG: --cluster-domain="" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712141 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712144 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 16:50:42.716239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712147 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712150 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712154 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712157 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712160 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712163 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712167 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712170 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712173 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712176 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712179 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712183 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712187 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712190 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712193 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712196 2582 flags.go:64] FLAG: --enable-server="true" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712199 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712206 2582 flags.go:64] FLAG: --event-burst="100" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712209 2582 flags.go:64] FLAG: --event-qps="50" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712212 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712220 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712224 2582 flags.go:64] FLAG: --eviction-hard="" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712227 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712230 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712233 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 16:50:42.716811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712236 2582 flags.go:64] FLAG: --eviction-soft="" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712239 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712242 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712245 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712248 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712250 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712253 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712256 2582 flags.go:64] FLAG: --feature-gates="" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712260 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712263 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712266 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712270 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712274 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712277 2582 flags.go:64] FLAG: --help="false" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712280 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-141-8.ec2.internal" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712283 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712286 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712289 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712292 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712297 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712300 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712303 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712305 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 16:50:42.717442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712308 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712311 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712314 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712317 2582 flags.go:64] FLAG: --kube-reserved="" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712320 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712328 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712332 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712335 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712338 2582 flags.go:64] FLAG: --lock-file="" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712341 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712344 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712347 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712352 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712356 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712358 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712361 2582 flags.go:64] FLAG: --logging-format="text" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712364 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712367 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712370 2582 flags.go:64] FLAG: --manifest-url="" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712373 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712378 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712382 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712386 2582 flags.go:64] FLAG: --max-pods="110" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712389 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712392 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 16:50:42.718036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712395 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712398 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712401 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712405 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712408 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712415 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712418 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712421 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712424 2582 flags.go:64] FLAG: --pod-cidr="" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712427 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712433 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712435 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712439 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712448 2582 flags.go:64] FLAG: --port="10250" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712451 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712454 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d36a05a009befba" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712457 2582 flags.go:64] FLAG: --qos-reserved="" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712460 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712463 2582 flags.go:64] FLAG: --register-node="true" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712466 2582 flags.go:64] FLAG: --register-with-taints="" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712469 2582 flags.go:64] FLAG: --registry-burst="10" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712472 2582 flags.go:64] FLAG: --registry-qps="5" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712475 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712478 2582 flags.go:64] FLAG: --reserved-memory="" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712481 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 16:50:42.718651 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712484 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712487 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712490 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712493 2582 flags.go:64] FLAG: --runonce="false" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712497 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712500 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712504 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712506 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712509 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712512 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712517 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712520 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712523 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712526 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712529 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712532 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712534 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712538 2582 flags.go:64] FLAG: --system-cgroups="" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712540 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712546 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712549 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712557 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712563 2582 flags.go:64] FLAG: --tls-min-version="" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712566 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712569 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 16:50:42.719262 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712572 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712575 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712578 2582 flags.go:64] FLAG: --v="2" Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712582 2582 flags.go:64] FLAG: --version="false" Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712586 2582 flags.go:64] FLAG: --vmodule="" Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712590 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.712593 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712727 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712730 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712734 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712737 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712741 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712744 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712747 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712749 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712752 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712754 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712758 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712761 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712764 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712767 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:50:42.719918 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712769 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712772 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712775 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712777 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712780 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712783 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712785 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712788 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712796 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712800 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712803 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712805 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712808 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712811 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712813 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712832 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712836 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712838 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712841 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712843 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:50:42.720436 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712846 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712849 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712853 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712855 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712858 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712861 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712864 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712866 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712871 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712873 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712876 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712878 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712881 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712884 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712887 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712889 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712892 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712894 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712897 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712899 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:50:42.720975 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712902 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712905 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712907 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712910 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712913 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712916 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712918 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712921 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712923 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712926 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712928 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712931 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712934 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712937 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712941 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712943 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712946 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712949 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712951 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712954 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:50:42.721553 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712958 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712961 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712963 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712968 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712971 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712974 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712977 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712980 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712983 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712987 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712989 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712992 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712996 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.712999 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713002 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713006 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713008 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713011 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713013 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:50:42.722055 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713016 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713019 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713021 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713024 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713026 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.713029 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.713037 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.720166 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.720181 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.721168 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.721180 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721238 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721243 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721246 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:50:42.722520 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721249 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721252 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721255 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721258 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721261 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721264 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721266 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721269 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721271 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721274 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721277 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721279 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721282 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721284 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721287 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721290 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721293 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721297 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721300 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721303 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:50:42.722889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721306 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721309 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721312 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721315 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721319 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721322 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721326 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721328 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721331 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721334 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721337 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721340 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721342 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721345 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721347 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721350 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721353 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721355 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721358 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:50:42.723364 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721361 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721363 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721366 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721368 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721371 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721373 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721376 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721378 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721381 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721384 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721386 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721389 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721391 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721394 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721396 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721399 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721401 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721404 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721406 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721409 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:50:42.723834 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721412 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721415 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721418 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721421 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721423 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721426 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721429 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721431 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721434 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721436 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721439 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721441 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721444 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721446 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721449 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721451 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721454 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721456 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721459 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721462 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:50:42.724325 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721464 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721467 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721469 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721472 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721475 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721477 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721480 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721483 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721487 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721490 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721493 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721496 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721499 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721503 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721505 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721508 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:50:42.724811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721510 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.721516 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721626 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721631 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721634 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721637 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721640 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721643 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721646 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721649 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721652 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721654 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721657 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721660 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721663 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:50:42.725329 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721665 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721668 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721670 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721672 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721675 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721678 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721681 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721685 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721688 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721690 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721693 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721696 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721699 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721701 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721704 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721707 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721709 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721712 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721714 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:50:42.725693 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721717 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721719 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721722 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721724 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721727 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721729 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721732 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721734 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721736 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721739 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721743 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721746 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721748 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721751 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721754 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721756 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721759 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721761 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721764 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:50:42.726163 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721766 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721769 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721771 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721774 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721776 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721780 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721784 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721787 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721790 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721793 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721796 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721800 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721802 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721805 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721808 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721811 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721814 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721832 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721835 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721837 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:50:42.726626 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721840 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721843 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721846 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721848 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721851 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721853 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721856 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721859 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721861 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721864 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721866 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721869 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721871 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721874 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721876 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721879 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721881 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721884 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721887 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721890 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:50:42.727126 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721892 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721895 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721898 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721902 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721904 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721907 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721909 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:42.721912 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.721917 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.722018 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.724339 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.725995 2582 server.go:1019] "Starting client certificate rotation" Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.726097 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 16:50:42.727599 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.726134 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 16:50:42.731479 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.731454 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 16:50:42.732665 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.732647 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 16:50:42.748441 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.748424 2582 log.go:25] "Validated CRI v1 runtime API" Jul 27 16:50:42.751474 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.751460 2582 log.go:25] "Validated CRI v1 image API" Jul 27 16:50:42.752286 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.752251 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 16:50:42.755583 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.755559 2582 fs.go:135] Filesystem UUIDs: map[4a10de38-e845-4679-976e-6c9bc2c4d487:/dev/nvme0n1p3 5eab4f2c-4377-4924-8617-d648555e8ac9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 27 16:50:42.755676 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.755581 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 16:50:42.757928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.757904 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 16:50:42.761129 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.761018 2582 manager.go:216] Machine: {Timestamp:2026-07-27 16:50:42.759299456 +0000 UTC m=+0.377004271 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3073663 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20a888c9a7dcaf6a2108b87d28552d SystemUUID:ec20a888-c9a7-dcaf-6a21-08b87d28552d BootID:cb853bc8-7caf-4490-b477-31b44b68b779 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:d2:ca:70:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:d2:ca:70:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:5f:1b:72:a8:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 16:50:42.761129 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.761122 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 16:50:42.761284 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.761271 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 16:50:42.764489 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.764461 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 16:50:42.764655 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.764492 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 16:50:42.765363 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.765350 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 16:50:42.765430 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.765368 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 16:50:42.765430 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.765378 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 16:50:42.765430 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.765398 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 16:50:42.767142 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.767129 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 16:50:42.770843 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.770805 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 27 16:50:42.771071 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771059 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 16:50:42.771142 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771095 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 27 16:50:42.771142 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771109 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 16:50:42.771142 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771129 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 16:50:42.771142 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771143 2582 kubelet.go:398] "Adding apiserver pod source" Jul 27 16:50:42.771299 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771155 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 16:50:42.771533 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771519 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 16:50:42.771597 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.771542 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 16:50:42.774499 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.774484 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 16:50:42.776965 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.776951 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 16:50:42.777018 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.776982 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 16:50:42.779107 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779095 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 16:50:42.779143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779112 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 16:50:42.779143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779118 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 16:50:42.779143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779124 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 16:50:42.779143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779132 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 16:50:42.779143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779138 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 16:50:42.779283 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779146 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 16:50:42.779283 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779151 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 16:50:42.779283 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779157 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 16:50:42.779283 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779162 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 16:50:42.779283 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779171 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 16:50:42.779283 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.779176 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 16:50:42.780028 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.780018 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 16:50:42.780028 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.780028 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 16:50:42.783532 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.783512 2582 server.go:1268] "Started kubelet" Jul 27 16:50:42.783661 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.783636 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 16:50:42.783768 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.783754 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 16:50:42.784156 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.784098 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 16:50:42.784250 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.784176 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 16:50:42.784303 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.784251 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 16:50:42.784313 ip-10-0-141-8 systemd[1]: Started Kubernetes Kubelet. Jul 27 16:50:42.785743 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.785727 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 16:50:42.786657 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.785723 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 16:50:42.789027 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.789008 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 27 16:50:42.789608 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.789586 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 16:50:42.792328 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.791231 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aec6c298f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.783472015 +0000 UTC m=+0.401176813,LastTimestamp:2026-07-27 16:50:42.783472015 +0000 UTC m=+0.401176813,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.797198 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.797181 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 16:50:42.797198 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.797192 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 16:50:42.797332 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.797287 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:42.797995 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.797971 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 16:50:42.797995 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.797970 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 16:50:42.797995 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.797998 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 16:50:42.798157 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798087 2582 factory.go:55] Registering systemd factory Jul 27 16:50:42.798157 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798101 2582 factory.go:223] Registration of the systemd container factory successfully Jul 27 16:50:42.798157 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798106 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 27 16:50:42.798157 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798113 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 27 16:50:42.798375 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798358 2582 factory.go:153] Registering CRI-O factory Jul 27 16:50:42.798425 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798377 2582 factory.go:223] Registration of the crio container factory successfully Jul 27 16:50:42.798472 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798428 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 16:50:42.798472 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798448 2582 factory.go:103] Registering Raw factory Jul 27 16:50:42.798472 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798459 2582 manager.go:1196] Started watching for new ooms in manager Jul 27 16:50:42.798767 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.798756 2582 manager.go:349] Starting recovery of all containers Jul 27 16:50:42.808319 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.808303 2582 manager.go:354] Recovery completed Jul 27 16:50:42.810778 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.810757 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 16:50:42.811002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.810983 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 16:50:42.811881 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.811866 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgmnt" Jul 27 16:50:42.814142 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.814127 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:42.816328 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.816303 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:42.816410 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.816342 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:42.816410 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.816357 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:42.817517 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.817503 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 16:50:42.817517 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.817517 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 16:50:42.817646 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.817521 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:42.817646 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.817537 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 27 16:50:42.818198 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.818184 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:42.818277 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.818212 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:42.818277 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.818223 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:42.819336 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.819317 2582 policy_none.go:49] "None policy: Start" Jul 27 16:50:42.819336 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.819335 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 16:50:42.819482 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.819345 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 16:50:42.819482 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.819387 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgmnt" Jul 27 16:50:42.821283 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.821270 2582 policy_none.go:47] "Start" Jul 27 16:50:42.827100 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.827012 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee6166e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816321251 +0000 UTC m=+0.434026048,LastTimestamp:2026-07-27 16:50:42.816321251 +0000 UTC m=+0.434026048,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.835397 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.835216 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee61d261 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816348769 +0000 UTC m=+0.434053562,LastTimestamp:2026-07-27 16:50:42.816348769 +0000 UTC m=+0.434053562,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.844209 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.844144 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee620a6e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816363118 +0000 UTC m=+0.434067913,LastTimestamp:2026-07-27 16:50:42.816363118 +0000 UTC m=+0.434067913,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.853929 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.853866 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-8.ec2.internal.18c6339aee6166e3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee6166e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816321251 +0000 UTC m=+0.434026048,LastTimestamp:2026-07-27 16:50:42.818196724 +0000 UTC m=+0.435901518,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.856375 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.856362 2582 manager.go:337] "Starting Device Plugin manager" Jul 27 16:50:42.856449 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.856395 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 16:50:42.856449 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.856409 2582 server.go:87] "Starting device plugin registration server" Jul 27 16:50:42.856650 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.856638 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 16:50:42.856703 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.856652 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 16:50:42.856765 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.856751 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 16:50:42.856911 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.856841 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 16:50:42.856911 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.856854 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 16:50:42.857352 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.857335 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 16:50:42.857435 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.857387 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:42.863389 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.863316 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-8.ec2.internal.18c6339aee61d261\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee61d261 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816348769 +0000 UTC m=+0.434053562,LastTimestamp:2026-07-27 16:50:42.818218146 +0000 UTC m=+0.435922939,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.874360 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.874287 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-8.ec2.internal.18c6339aee620a6e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee620a6e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816363118 +0000 UTC m=+0.434067913,LastTimestamp:2026-07-27 16:50:42.818227595 +0000 UTC m=+0.435932388,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.885120 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.885066 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339af0fd5e25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.860097061 +0000 UTC m=+0.477801844,LastTimestamp:2026-07-27 16:50:42.860097061 +0000 UTC m=+0.477801844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.957499 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.957407 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:42.958459 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.958433 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:42.958563 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.958465 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:42.958563 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.958476 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:42.958563 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:42.958513 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-8.ec2.internal" Jul 27 16:50:42.966039 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.965956 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-8.ec2.internal.18c6339aee6166e3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee6166e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816321251 +0000 UTC m=+0.434026048,LastTimestamp:2026-07-27 16:50:42.958450907 +0000 UTC m=+0.576155699,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:42.967740 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.967717 2582 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-141-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-141-8.ec2.internal" Jul 27 16:50:42.967809 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:42.967744 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-8.ec2.internal.18c6339aee61d261\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c6339aee61d261 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-27 16:50:42.816348769 +0000 UTC m=+0.434053562,LastTimestamp:2026-07-27 16:50:42.958469696 +0000 UTC m=+0.576174488,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}" Jul 27 16:50:43.017630 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.017594 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-8.ec2.internal\" not found" node="ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.022069 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.022034 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 16:50:43.023308 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.023289 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 16:50:43.023417 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.023323 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 16:50:43.023417 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.023346 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 16:50:43.023417 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.023377 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 16:50:43.025780 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.025761 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:50:43.124246 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.124209 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"] Jul 27 16:50:43.124367 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.124298 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:43.126345 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.126327 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:43.126444 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.126357 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:43.126444 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.126367 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:43.128433 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.128421 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:43.128567 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.128551 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.128604 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.128585 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:43.129212 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.129191 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:43.129309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.129218 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:43.129309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.129241 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:43.129309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.129251 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:43.129309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.129221 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:43.129309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.129294 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:43.131421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.131403 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.131516 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.131435 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:43.133668 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.133652 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:43.133760 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.133681 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:43.133760 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.133695 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:43.163789 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.163759 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-8.ec2.internal\" not found" node="ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.168099 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.168086 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:43.168205 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.168190 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-8.ec2.internal\" not found" node="ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.169648 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.169628 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:43.169759 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.169664 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:43.169759 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.169679 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:43.169759 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.169707 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.180339 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.180323 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.180398 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.180346 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-8.ec2.internal\": node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.199879 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.199855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02e347c5a565e7ca31c487460ef9125d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"02e347c5a565e7ca31c487460ef9125d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.199879 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.199879 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e347c5a565e7ca31c487460ef9125d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"02e347c5a565e7ca31c487460ef9125d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.200029 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.199896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a9939c2d7b33472f9d99dd0a21c376b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-8.ec2.internal\" (UID: \"5a9939c2d7b33472f9d99dd0a21c376b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.206099 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.206080 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.300150 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.300049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02e347c5a565e7ca31c487460ef9125d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"02e347c5a565e7ca31c487460ef9125d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.300150 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.300097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e347c5a565e7ca31c487460ef9125d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"02e347c5a565e7ca31c487460ef9125d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.300150 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.300114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a9939c2d7b33472f9d99dd0a21c376b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-8.ec2.internal\" (UID: \"5a9939c2d7b33472f9d99dd0a21c376b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.300361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.300168 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5a9939c2d7b33472f9d99dd0a21c376b-config\") pod \"kube-apiserver-proxy-ip-10-0-141-8.ec2.internal\" (UID: \"5a9939c2d7b33472f9d99dd0a21c376b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.300361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.300168 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e347c5a565e7ca31c487460ef9125d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"02e347c5a565e7ca31c487460ef9125d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.300361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.300168 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02e347c5a565e7ca31c487460ef9125d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"02e347c5a565e7ca31c487460ef9125d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.307191 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.307162 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.407767 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.407725 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.465939 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.465903 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.471671 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.471654 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" Jul 27 16:50:43.508495 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.508468 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.608745 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.608703 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.692704 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.692678 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:50:43.709720 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.709697 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.724990 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.724962 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 16:50:43.725109 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.725090 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 16:50:43.725159 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.725132 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 16:50:43.810808 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.810773 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.911158 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:43.911083 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:43.970326 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.970285 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 16:45:43 +0000 UTC" deadline="2028-01-03 00:32:42.741299609 +0000 UTC" Jul 27 16:50:43.970503 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:43.970336 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12583h41m58.770975919s" Jul 27 16:50:44.011272 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.011231 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:44.011272 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.011239 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:50:44.012872 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.012842 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:50:44.012964 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.012892 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:50:44.012964 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.012909 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:50:44.075574 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:44.075532 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e347c5a565e7ca31c487460ef9125d.slice/crio-fb2d134f9488923ae21b824c44e897edbeaee7af762527f026866021758adc68 WatchSource:0}: Error finding container fb2d134f9488923ae21b824c44e897edbeaee7af762527f026866021758adc68: Status 404 returned error can't find the container with id fb2d134f9488923ae21b824c44e897edbeaee7af762527f026866021758adc68 Jul 27 16:50:44.081075 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.081052 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:50:44.086811 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:44.086786 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9939c2d7b33472f9d99dd0a21c376b.slice/crio-d5c57bf20b0159aa98bed4eab8f5c747538a672c523ce2a7782ad0dd693b8263 WatchSource:0}: Error finding container d5c57bf20b0159aa98bed4eab8f5c747538a672c523ce2a7782ad0dd693b8263: Status 404 returned error can't find the container with id d5c57bf20b0159aa98bed4eab8f5c747538a672c523ce2a7782ad0dd693b8263 Jul 27 16:50:44.111798 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.111764 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found" Jul 27 16:50:44.191744 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.191668 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:50:44.197623 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.197605 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" Jul 27 16:50:44.203352 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.203332 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:50:44.205586 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.205568 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 16:50:44.206795 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.206780 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" Jul 27 16:50:44.218809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.218789 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 16:50:44.774868 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.774835 2582 apiserver.go:52] "Watching apiserver" Jul 27 16:50:44.782671 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.782638 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 16:50:44.783037 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.783009 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-sjrqj","openshift-network-operator/iptables-alerter-lck79","openshift-ovn-kubernetes/ovnkube-node-svr4j","kube-system/global-pull-secret-syncer-lz5dv","kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29","openshift-cluster-node-tuning-operator/tuned-g7654","openshift-dns/node-resolver-whfns","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal","openshift-multus/multus-additional-cni-plugins-bzzzp","openshift-network-diagnostics/network-check-target-spsdn","kube-system/konnectivity-agent-sgqp4","openshift-image-registry/node-ca-hhqxq","openshift-multus/multus-jl7pk"] Jul 27 16:50:44.785629 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.785606 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.787931 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.787900 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.788074 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.788052 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dcb9l\"" Jul 27 16:50:44.788139 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.788080 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 16:50:44.788307 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.788286 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 16:50:44.791416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.790372 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.791416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.790455 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-79fgk\"" Jul 27 16:50:44.791416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.790644 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 16:50:44.791416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.790695 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 16:50:44.791416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.790822 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 16:50:44.791416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.790877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 16:50:44.792319 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.792298 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 16:50:44.792691 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.792659 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:50:44.792780 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.792721 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njzql\"" Jul 27 16:50:44.792780 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.792749 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.792915 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.792818 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:44.795624 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.795601 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.799381 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.799356 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 16:50:44.800133 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.800109 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p5f7t\"" Jul 27 16:50:44.800232 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.800139 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 16:50:44.800350 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.800336 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 16:50:44.800458 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.800444 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 16:50:44.800636 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.800619 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:44.800702 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.800681 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:44.802855 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.802833 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.804944 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.804922 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 16:50:44.805147 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.805128 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w9v6f\"" Jul 27 16:50:44.805351 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.805327 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 16:50:44.805351 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.805344 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 16:50:44.805487 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.805339 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 16:50:44.805595 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.805571 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.806107 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.806088 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 16:50:44.806351 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.806332 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 16:50:44.807940 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.807916 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 16:50:44.808056 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.808034 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6fv78\"" Jul 27 16:50:44.808404 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.808387 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:44.808497 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.808469 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:50:44.808821 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.808798 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 16:50:44.809155 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809132 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f97815a-35d9-470a-a9c9-1ee7af844642-hosts-file\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.809274 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-daemon-config\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809274 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtnp8\" (UniqueName: \"kubernetes.io/projected/33972e58-fe51-4593-96fa-06b5e7b11b30-kube-api-access-rtnp8\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809274 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-run\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.809500 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-device-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.809500 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb5k6\" (UniqueName: \"kubernetes.io/projected/d5112f20-537d-43db-942a-99bce84e90e4-kube-api-access-lb5k6\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.809616 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-system-cni-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809616 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809518 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-cni-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809616 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-cnibin\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809616 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-modprobe-d\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.809616 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.809616 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-sys-fs\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-socket-dir-parent\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-etc-kubernetes\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysctl-d\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809682 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-host\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-registration-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bd5r\" (UniqueName: \"kubernetes.io/projected/2f97815a-35d9-470a-a9c9-1ee7af844642-kube-api-access-9bd5r\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-netns\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809774 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-cni-multus\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809789 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-conf-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-multus-certs\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809822 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysctl-conf\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-sys\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-tuned\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809872 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97815a-35d9-470a-a9c9-1ee7af844642-tmp-dir\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.809976 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.809887 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-var-lib-kubelet\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810040 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-os-release\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810059 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33972e58-fe51-4593-96fa-06b5e7b11b30-cni-binary-copy\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-k8s-cni-cncf-io\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-cni-bin\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-hostroot\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-systemd\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810221 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-lib-modules\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e7d0917-8d76-4bed-b352-3c2d0fde827a-tmp\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810256 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-kubelet\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810282 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jgv\" (UniqueName: \"kubernetes.io/projected/4e7d0917-8d76-4bed-b352-3c2d0fde827a-kube-api-access-s7jgv\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysconfig\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-kubernetes\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7aad7c5c-40cb-4533-8095-01c95334bf4f-kubelet-config\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7aad7c5c-40cb-4533-8095-01c95334bf4f-dbus\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.810726 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-socket-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.811589 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810527 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:44.811589 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.810570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26r4w\" (UniqueName: \"kubernetes.io/projected/8c0a30c1-ed92-447a-a426-427bdffa913b-kube-api-access-26r4w\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:44.811698 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.811657 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 16:50:44.812802 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.812517 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:44.814554 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.814324 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7t2fd\"" Jul 27 16:50:44.814667 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.814642 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 16:50:44.814935 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.814912 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 16:50:44.815356 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.815336 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:44.817811 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.817793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:44.818005 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.817973 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 16:50:44.818215 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.818191 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6jv45\"" Jul 27 16:50:44.818569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.818428 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 16:50:44.818569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.818460 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 16:50:44.819744 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.819716 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 16:50:44.819744 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.819737 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 16:50:44.820051 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.820033 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:50:44.820130 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.820109 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w4wj8\"" Jul 27 16:50:44.838152 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.838118 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nt87n" Jul 27 16:50:44.849887 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.849864 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nt87n" Jul 27 16:50:44.899438 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.899405 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 16:50:44.911641 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911610 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysconfig\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.911809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7aad7c5c-40cb-4533-8095-01c95334bf4f-kubelet-config\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.911809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911677 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7aad7c5c-40cb-4533-8095-01c95334bf4f-dbus\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.911809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26r4w\" (UniqueName: \"kubernetes.io/projected/8c0a30c1-ed92-447a-a426-427bdffa913b-kube-api-access-26r4w\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:44.911809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911730 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-var-lib-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.911809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-ovn\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.911809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/388fa658-3a4d-49e6-b70e-2088f86f68ad-iptables-alerter-script\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:44.911809 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f97815a-35d9-470a-a9c9-1ee7af844642-hosts-file\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-daemon-config\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911870 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb5k6\" (UniqueName: \"kubernetes.io/projected/d5112f20-537d-43db-942a-99bce84e90e4-kube-api-access-lb5k6\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-system-cni-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911921 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-cni-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911947 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-cnibin\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4aa87403-1a29-4193-9948-c9805d93f3a8-serviceca\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.911998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovn-node-metrics-cert\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-socket-dir-parent\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912051 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovnkube-config\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj98p\" (UniqueName: \"kubernetes.io/projected/60c6ae70-8209-4710-89ab-b4844f954466-kube-api-access-vj98p\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-netns\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-sys\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-tuned\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.912206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912189 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-systemd-units\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912215 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-systemd\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-var-lib-kubelet\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-kubelet\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912294 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-cni-bin\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-env-overrides\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912352 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/388fa658-3a4d-49e6-b70e-2088f86f68ad-host-slash\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912379 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33972e58-fe51-4593-96fa-06b5e7b11b30-cni-binary-copy\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-lib-modules\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912432 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e7d0917-8d76-4bed-b352-3c2d0fde827a-tmp\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-slash\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912528 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-etc-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-kubelet\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-log-socket\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912607 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-cni-netd\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-kubernetes\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.912919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912661 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-socket-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912717 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtnp8\" (UniqueName: \"kubernetes.io/projected/33972e58-fe51-4593-96fa-06b5e7b11b30-kube-api-access-rtnp8\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912741 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-netns\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912850 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-run\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912862 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f97815a-35d9-470a-a9c9-1ee7af844642-hosts-file\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-device-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912925 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcq8f\" (UniqueName: \"kubernetes.io/projected/4aa87403-1a29-4193-9948-c9805d93f3a8-kube-api-access-zcq8f\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912977 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-socket-dir-parent\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.912990 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-modprobe-d\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-var-lib-kubelet\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913150 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913211 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-sys-fs\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913307 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysconfig\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.913754 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913357 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-system-cni-dir\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913385 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-etc-kubernetes\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913437 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7aad7c5c-40cb-4533-8095-01c95334bf4f-kubelet-config\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913445 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysctl-d\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-host\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913386 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-daemon-config\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913560 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-etc-kubernetes\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913552 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33972e58-fe51-4593-96fa-06b5e7b11b30-cni-binary-copy\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913630 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysctl-d\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913664 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.913652 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913721 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-lib-modules\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913726 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-cnibin\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.913749 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret podName:7aad7c5c-40cb-4533-8095-01c95334bf4f nodeName:}" failed. No retries permitted until 2026-07-27 16:50:45.413729373 +0000 UTC m=+3.031434155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret") pod "global-pull-secret-syncer-lz5dv" (UID: "7aad7c5c-40cb-4533-8095-01c95334bf4f") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913776 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-system-cni-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.914738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913788 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-device-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913809 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-sys\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913837 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-run\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913845 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-sys-fs\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913858 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7aad7c5c-40cb-4533-8095-01c95334bf4f-dbus\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-registration-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913880 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-kubelet\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913914 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-node-log\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913928 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-cni-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovnkube-script-lib\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913961 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-modprobe-d\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.913976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bd5r\" (UniqueName: \"kubernetes.io/projected/2f97815a-35d9-470a-a9c9-1ee7af844642-kube-api-access-9bd5r\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914005 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-kubernetes\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.914046 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914054 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-registration-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-cni-multus\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914102 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-host\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.915672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914113 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-conf-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:44.914135 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs podName:8c0a30c1-ed92-447a-a426-427bdffa913b nodeName:}" failed. No retries permitted until 2026-07-27 16:50:45.414115733 +0000 UTC m=+3.031820521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs") pod "network-metrics-daemon-sjrqj" (UID: "8c0a30c1-ed92-447a-a426-427bdffa913b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-socket-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914193 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-multus-conf-dir\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914235 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-cni-multus\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914248 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-multus-certs\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysctl-conf\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914305 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-multus-certs\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914427 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-sysctl-conf\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-run-netns\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97815a-35d9-470a-a9c9-1ee7af844642-tmp-dir\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914612 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqjcf\" (UniqueName: \"kubernetes.io/projected/63936cfb-9df8-40a1-86c6-9d08390b1e0e-kube-api-access-xqjcf\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5112f20-537d-43db-942a-99bce84e90e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-os-release\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.916569 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914662 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914687 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-os-release\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-k8s-cni-cncf-io\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-cni-bin\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-hostroot\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914781 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-systemd\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914800 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-run-k8s-cni-cncf-io\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914891 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-os-release\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jgv\" (UniqueName: \"kubernetes.io/projected/4e7d0917-8d76-4bed-b352-3c2d0fde827a-kube-api-access-s7jgv\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914932 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cfde1ed1-7432-442b-afb4-bac9db6017ef-agent-certs\") pod \"konnectivity-agent-sgqp4\" (UID: \"cfde1ed1-7432-442b-afb4-bac9db6017ef\") " pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914948 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-host-var-lib-cni-bin\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914937 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97815a-35d9-470a-a9c9-1ee7af844642-tmp-dir\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.914963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-cnibin\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.915078 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cfde1ed1-7432-442b-afb4-bac9db6017ef-konnectivity-ca\") pod \"konnectivity-agent-sgqp4\" (UID: \"cfde1ed1-7432-442b-afb4-bac9db6017ef\") " pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.915108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aa87403-1a29-4193-9948-c9805d93f3a8-host\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.915109 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33972e58-fe51-4593-96fa-06b5e7b11b30-hostroot\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.915133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:44.917421 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.915163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:44.918350 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.915178 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-systemd\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.918350 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.915210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gxs\" (UniqueName: \"kubernetes.io/projected/388fa658-3a4d-49e6-b70e-2088f86f68ad-kube-api-access-26gxs\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:44.918590 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.918571 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e7d0917-8d76-4bed-b352-3c2d0fde827a-etc-tuned\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.918812 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.918789 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e7d0917-8d76-4bed-b352-3c2d0fde827a-tmp\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.927398 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.927311 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bd5r\" (UniqueName: \"kubernetes.io/projected/2f97815a-35d9-470a-a9c9-1ee7af844642-kube-api-access-9bd5r\") pod \"node-resolver-whfns\" (UID: \"2f97815a-35d9-470a-a9c9-1ee7af844642\") " pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:44.930019 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.929959 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb5k6\" (UniqueName: \"kubernetes.io/projected/d5112f20-537d-43db-942a-99bce84e90e4-kube-api-access-lb5k6\") pod \"aws-ebs-csi-driver-node-nmq29\" (UID: \"d5112f20-537d-43db-942a-99bce84e90e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:44.930794 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.930525 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26r4w\" (UniqueName: \"kubernetes.io/projected/8c0a30c1-ed92-447a-a426-427bdffa913b-kube-api-access-26r4w\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:44.931349 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.931322 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jgv\" (UniqueName: \"kubernetes.io/projected/4e7d0917-8d76-4bed-b352-3c2d0fde827a-kube-api-access-s7jgv\") pod \"tuned-g7654\" (UID: \"4e7d0917-8d76-4bed-b352-3c2d0fde827a\") " pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:44.933098 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:44.933055 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtnp8\" (UniqueName: \"kubernetes.io/projected/33972e58-fe51-4593-96fa-06b5e7b11b30-kube-api-access-rtnp8\") pod \"multus-jl7pk\" (UID: \"33972e58-fe51-4593-96fa-06b5e7b11b30\") " pod="openshift-multus/multus-jl7pk" Jul 27 16:50:45.015757 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqjcf\" (UniqueName: \"kubernetes.io/projected/63936cfb-9df8-40a1-86c6-9d08390b1e0e-kube-api-access-xqjcf\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.015960 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-os-release\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.015960 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.015960 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cfde1ed1-7432-442b-afb4-bac9db6017ef-agent-certs\") pod \"konnectivity-agent-sgqp4\" (UID: \"cfde1ed1-7432-442b-afb4-bac9db6017ef\") " pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:45.015960 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015909 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-cnibin\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.015960 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cfde1ed1-7432-442b-afb4-bac9db6017ef-konnectivity-ca\") pod \"konnectivity-agent-sgqp4\" (UID: \"cfde1ed1-7432-442b-afb4-bac9db6017ef\") " pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015962 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aa87403-1a29-4193-9948-c9805d93f3a8-host\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.015960 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-os-release\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016007 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-cnibin\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016112 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gxs\" (UniqueName: \"kubernetes.io/projected/388fa658-3a4d-49e6-b70e-2088f86f68ad-kube-api-access-26gxs\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016147 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-var-lib-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-ovn\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.016263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016183 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016484 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-var-lib-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016544 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aa87403-1a29-4193-9948-c9805d93f3a8-host\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016191 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/388fa658-3a4d-49e6-b70e-2088f86f68ad-iptables-alerter-script\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4aa87403-1a29-4193-9948-c9805d93f3a8-serviceca\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016622 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovn-node-metrics-cert\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016674 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovnkube-config\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016700 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj98p\" (UniqueName: \"kubernetes.io/projected/60c6ae70-8209-4710-89ab-b4844f954466-kube-api-access-vj98p\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016711 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cfde1ed1-7432-442b-afb4-bac9db6017ef-konnectivity-ca\") pod \"konnectivity-agent-sgqp4\" (UID: \"cfde1ed1-7432-442b-afb4-bac9db6017ef\") " pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:45.016728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-systemd-units\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016754 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016763 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-systemd\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-kubelet\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016818 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-cni-bin\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-env-overrides\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016826 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-systemd\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/388fa658-3a4d-49e6-b70e-2088f86f68ad-host-slash\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016890 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/388fa658-3a4d-49e6-b70e-2088f86f68ad-host-slash\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016764 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-systemd-units\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-slash\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016946 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-kubelet\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-etc-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016980 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-cni-bin\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-log-socket\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017013 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-cni-netd\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcq8f\" (UniqueName: \"kubernetes.io/projected/4aa87403-1a29-4193-9948-c9805d93f3a8-kube-api-access-zcq8f\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:45.017201 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017153 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/388fa658-3a4d-49e6-b70e-2088f86f68ad-iptables-alerter-script\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.016595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-ovn\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017196 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-system-cni-dir\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017240 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-slash\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-node-log\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovnkube-script-lib\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-run-netns\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017383 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-log-socket\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017432 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-env-overrides\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017445 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-etc-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017447 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.018105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017481 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-run-openvswitch\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017491 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-node-log\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017574 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-cni-netd\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63936cfb-9df8-40a1-86c6-9d08390b1e0e-host-run-netns\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4aa87403-1a29-4193-9948-c9805d93f3a8-serviceca\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017682 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60c6ae70-8209-4710-89ab-b4844f954466-system-cni-dir\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017724 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.017892 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovnkube-config\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.018071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60c6ae70-8209-4710-89ab-b4844f954466-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.019043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.018116 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovnkube-script-lib\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.020123 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.020092 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63936cfb-9df8-40a1-86c6-9d08390b1e0e-ovn-node-metrics-cert\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.020435 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.020412 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cfde1ed1-7432-442b-afb4-bac9db6017ef-agent-certs\") pod \"konnectivity-agent-sgqp4\" (UID: \"cfde1ed1-7432-442b-afb4-bac9db6017ef\") " pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:45.028483 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.028415 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqjcf\" (UniqueName: \"kubernetes.io/projected/63936cfb-9df8-40a1-86c6-9d08390b1e0e-kube-api-access-xqjcf\") pod \"ovnkube-node-svr4j\" (UID: \"63936cfb-9df8-40a1-86c6-9d08390b1e0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.031573 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.030717 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:50:45.031573 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.030743 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:50:45.031573 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.030765 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wmkm6 for pod openshift-network-diagnostics/network-check-target-spsdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:45.031573 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.031109 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6 podName:9d97b403-3995-4419-8c1e-be90f78de9b0 nodeName:}" failed. No retries permitted until 2026-07-27 16:50:45.531082973 +0000 UTC m=+3.148787772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wmkm6" (UniqueName: "kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6") pod "network-check-target-spsdn" (UID: "9d97b403-3995-4419-8c1e-be90f78de9b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:45.034422 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.034363 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcq8f\" (UniqueName: \"kubernetes.io/projected/4aa87403-1a29-4193-9948-c9805d93f3a8-kube-api-access-zcq8f\") pod \"node-ca-hhqxq\" (UID: \"4aa87403-1a29-4193-9948-c9805d93f3a8\") " pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:45.037513 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.037463 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj98p\" (UniqueName: \"kubernetes.io/projected/60c6ae70-8209-4710-89ab-b4844f954466-kube-api-access-vj98p\") pod \"multus-additional-cni-plugins-bzzzp\" (UID: \"60c6ae70-8209-4710-89ab-b4844f954466\") " pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.038167 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.038144 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gxs\" (UniqueName: \"kubernetes.io/projected/388fa658-3a4d-49e6-b70e-2088f86f68ad-kube-api-access-26gxs\") pod \"iptables-alerter-lck79\" (UID: \"388fa658-3a4d-49e6-b70e-2088f86f68ad\") " pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:45.040966 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.040921 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" event={"ID":"5a9939c2d7b33472f9d99dd0a21c376b","Type":"ContainerStarted","Data":"d5c57bf20b0159aa98bed4eab8f5c747538a672c523ce2a7782ad0dd693b8263"} Jul 27 16:50:45.043134 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.043094 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" event={"ID":"02e347c5a565e7ca31c487460ef9125d","Type":"ContainerStarted","Data":"fb2d134f9488923ae21b824c44e897edbeaee7af762527f026866021758adc68"} Jul 27 16:50:45.097608 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.097567 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whfns" Jul 27 16:50:45.108308 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.108278 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jl7pk" Jul 27 16:50:45.120533 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.120509 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7654" Jul 27 16:50:45.128691 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.128651 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" Jul 27 16:50:45.135910 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.135890 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:50:45.144944 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.144791 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" Jul 27 16:50:45.152753 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.152718 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:50:45.159714 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.159693 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hhqxq" Jul 27 16:50:45.168929 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.168906 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lck79" Jul 27 16:50:45.182395 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.182195 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:50:45.421002 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.420954 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:45.421216 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.421089 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:45.421216 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.421145 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:45.421333 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.421234 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret podName:7aad7c5c-40cb-4533-8095-01c95334bf4f nodeName:}" failed. No retries permitted until 2026-07-27 16:50:46.421211632 +0000 UTC m=+4.038916429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret") pod "global-pull-secret-syncer-lz5dv" (UID: "7aad7c5c-40cb-4533-8095-01c95334bf4f") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:45.421333 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.421234 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:45.421333 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.421282 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs podName:8c0a30c1-ed92-447a-a426-427bdffa913b nodeName:}" failed. No retries permitted until 2026-07-27 16:50:46.421270903 +0000 UTC m=+4.038975700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs") pod "network-metrics-daemon-sjrqj" (UID: "8c0a30c1-ed92-447a-a426-427bdffa913b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:45.622807 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.622769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:45.623004 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.622938 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:50:45.623004 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.622959 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:50:45.623004 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.622969 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wmkm6 for pod openshift-network-diagnostics/network-check-target-spsdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:45.623133 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:45.623025 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6 podName:9d97b403-3995-4419-8c1e-be90f78de9b0 nodeName:}" failed. No retries permitted until 2026-07-27 16:50:46.623010105 +0000 UTC m=+4.240714885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmkm6" (UniqueName: "kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6") pod "network-check-target-spsdn" (UID: "9d97b403-3995-4419-8c1e-be90f78de9b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:45.657547 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.657514 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:50:45.854734 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.854654 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:45:45 +0000 UTC" deadline="2028-04-05 23:48:54.966243296 +0000 UTC" Jul 27 16:50:45.854734 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:45.854729 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14838h58m9.111518117s" Jul 27 16:50:46.024235 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:46.024195 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:46.024428 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.024342 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:46.159787 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.159757 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7d0917_8d76_4bed_b352_3c2d0fde827a.slice/crio-1b8766134320be41592834fb6632ae2a8213ea3ca7d5646ab2d72db1e47ff392 WatchSource:0}: Error finding container 1b8766134320be41592834fb6632ae2a8213ea3ca7d5646ab2d72db1e47ff392: Status 404 returned error can't find the container with id 1b8766134320be41592834fb6632ae2a8213ea3ca7d5646ab2d72db1e47ff392 Jul 27 16:50:46.161500 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.161452 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa87403_1a29_4193_9948_c9805d93f3a8.slice/crio-d1afba92fe96b7e2671534851cc0363aa38d639e9637c90e46dd3a23cf834d3f WatchSource:0}: Error finding container d1afba92fe96b7e2671534851cc0363aa38d639e9637c90e46dd3a23cf834d3f: Status 404 returned error can't find the container with id d1afba92fe96b7e2671534851cc0363aa38d639e9637c90e46dd3a23cf834d3f Jul 27 16:50:46.163603 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.162349 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfde1ed1_7432_442b_afb4_bac9db6017ef.slice/crio-f94d79e6543594cf4927db1cf2761130652d66dee25855ef33aba38029c4e963 WatchSource:0}: Error finding container f94d79e6543594cf4927db1cf2761130652d66dee25855ef33aba38029c4e963: Status 404 returned error can't find the container with id f94d79e6543594cf4927db1cf2761130652d66dee25855ef33aba38029c4e963 Jul 27 16:50:46.166550 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.166516 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388fa658_3a4d_49e6_b70e_2088f86f68ad.slice/crio-7e5878df184b3049581ff7bedf6e2e225a3791a20953adb9201e123abee7ca92 WatchSource:0}: Error finding container 7e5878df184b3049581ff7bedf6e2e225a3791a20953adb9201e123abee7ca92: Status 404 returned error can't find the container with id 7e5878df184b3049581ff7bedf6e2e225a3791a20953adb9201e123abee7ca92 Jul 27 16:50:46.167189 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.167162 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5112f20_537d_43db_942a_99bce84e90e4.slice/crio-dc3b975a4735bb15db2332c2877be1b96e79e4979f97154e9577f97f92edaa7a WatchSource:0}: Error finding container dc3b975a4735bb15db2332c2877be1b96e79e4979f97154e9577f97f92edaa7a: Status 404 returned error can't find the container with id dc3b975a4735bb15db2332c2877be1b96e79e4979f97154e9577f97f92edaa7a Jul 27 16:50:46.168433 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.168405 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63936cfb_9df8_40a1_86c6_9d08390b1e0e.slice/crio-c12c3ea3afbfafc5b4c2a2ae3ba9823a8056e001c471f5bd1895a20bbeffa395 WatchSource:0}: Error finding container c12c3ea3afbfafc5b4c2a2ae3ba9823a8056e001c471f5bd1895a20bbeffa395: Status 404 returned error can't find the container with id c12c3ea3afbfafc5b4c2a2ae3ba9823a8056e001c471f5bd1895a20bbeffa395 Jul 27 16:50:46.193385 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.193279 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f97815a_35d9_470a_a9c9_1ee7af844642.slice/crio-f97aa634f20dc949cd115a57d47838ef97eeb32573802e36aa662ce7b917c457 WatchSource:0}: Error finding container f97aa634f20dc949cd115a57d47838ef97eeb32573802e36aa662ce7b917c457: Status 404 returned error can't find the container with id f97aa634f20dc949cd115a57d47838ef97eeb32573802e36aa662ce7b917c457 Jul 27 16:50:46.193876 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:50:46.193851 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c6ae70_8209_4710_89ab_b4844f954466.slice/crio-a57b5f3711637d406137ac2a8ed3c8ac72cdfdab456bb1a778fc23be5a91ec3d WatchSource:0}: Error finding container a57b5f3711637d406137ac2a8ed3c8ac72cdfdab456bb1a778fc23be5a91ec3d: Status 404 returned error can't find the container with id a57b5f3711637d406137ac2a8ed3c8ac72cdfdab456bb1a778fc23be5a91ec3d Jul 27 16:50:46.429511 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:46.429328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:46.429613 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:46.429527 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:46.429613 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.429476 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:46.429705 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.429615 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:46.429705 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.429640 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs podName:8c0a30c1-ed92-447a-a426-427bdffa913b nodeName:}" failed. No retries permitted until 2026-07-27 16:50:48.429623089 +0000 UTC m=+6.047327874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs") pod "network-metrics-daemon-sjrqj" (UID: "8c0a30c1-ed92-447a-a426-427bdffa913b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:46.429705 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.429657 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret podName:7aad7c5c-40cb-4533-8095-01c95334bf4f nodeName:}" failed. No retries permitted until 2026-07-27 16:50:48.429649296 +0000 UTC m=+6.047354077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret") pod "global-pull-secret-syncer-lz5dv" (UID: "7aad7c5c-40cb-4533-8095-01c95334bf4f") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:46.630836 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:46.630798 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:46.631521 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.631013 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:50:46.631521 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.631045 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:50:46.631521 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.631060 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wmkm6 for pod openshift-network-diagnostics/network-check-target-spsdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:46.631521 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:46.631130 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6 podName:9d97b403-3995-4419-8c1e-be90f78de9b0 nodeName:}" failed. No retries permitted until 2026-07-27 16:50:48.63110823 +0000 UTC m=+6.248813026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmkm6" (UniqueName: "kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6") pod "network-check-target-spsdn" (UID: "9d97b403-3995-4419-8c1e-be90f78de9b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:46.858255 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:46.858187 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:45:45 +0000 UTC" deadline="2028-02-21 15:52:21.849681603 +0000 UTC" Jul 27 16:50:46.858255 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:46.858224 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13775h1m34.991461875s" Jul 27 16:50:47.026555 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.026521 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:47.026728 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:47.026674 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:47.026810 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.026745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:47.026810 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:47.026795 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:50:47.051165 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.051124 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hhqxq" event={"ID":"4aa87403-1a29-4193-9948-c9805d93f3a8","Type":"ContainerStarted","Data":"d1afba92fe96b7e2671534851cc0363aa38d639e9637c90e46dd3a23cf834d3f"} Jul 27 16:50:47.059411 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.059381 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7654" event={"ID":"4e7d0917-8d76-4bed-b352-3c2d0fde827a","Type":"ContainerStarted","Data":"1b8766134320be41592834fb6632ae2a8213ea3ca7d5646ab2d72db1e47ff392"} Jul 27 16:50:47.065940 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.065172 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" event={"ID":"5a9939c2d7b33472f9d99dd0a21c376b","Type":"ContainerStarted","Data":"e34a014ae85fea3d9633fbbae034bdcafd4ce73f4f203c6c982ca6c579c9835a"} Jul 27 16:50:47.071810 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.071710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" event={"ID":"d5112f20-537d-43db-942a-99bce84e90e4","Type":"ContainerStarted","Data":"dc3b975a4735bb15db2332c2877be1b96e79e4979f97154e9577f97f92edaa7a"} Jul 27 16:50:47.075879 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.075806 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whfns" event={"ID":"2f97815a-35d9-470a-a9c9-1ee7af844642","Type":"ContainerStarted","Data":"f97aa634f20dc949cd115a57d47838ef97eeb32573802e36aa662ce7b917c457"} Jul 27 16:50:47.080581 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.080511 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lck79" event={"ID":"388fa658-3a4d-49e6-b70e-2088f86f68ad","Type":"ContainerStarted","Data":"7e5878df184b3049581ff7bedf6e2e225a3791a20953adb9201e123abee7ca92"} Jul 27 16:50:47.087630 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.087565 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jl7pk" event={"ID":"33972e58-fe51-4593-96fa-06b5e7b11b30","Type":"ContainerStarted","Data":"29e181e9df4f366b9cee6b8ef0eb24923052c714fce3e5aa1996a28215c7ad45"} Jul 27 16:50:47.091252 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.091222 2582 generic.go:356] "Generic (PLEG): container finished" podID="02e347c5a565e7ca31c487460ef9125d" containerID="572afb359eb1e34bc8d28e801e4ba998cac9cfc0e61166d015cd8f714f9005d4" exitCode=0 Jul 27 16:50:47.091368 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.091338 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" event={"ID":"02e347c5a565e7ca31c487460ef9125d","Type":"ContainerDied","Data":"572afb359eb1e34bc8d28e801e4ba998cac9cfc0e61166d015cd8f714f9005d4"} Jul 27 16:50:47.096746 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.096714 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerStarted","Data":"a57b5f3711637d406137ac2a8ed3c8ac72cdfdab456bb1a778fc23be5a91ec3d"} Jul 27 16:50:47.099397 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.099372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"c12c3ea3afbfafc5b4c2a2ae3ba9823a8056e001c471f5bd1895a20bbeffa395"} Jul 27 16:50:47.102063 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.102037 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgqp4" event={"ID":"cfde1ed1-7432-442b-afb4-bac9db6017ef","Type":"ContainerStarted","Data":"f94d79e6543594cf4927db1cf2761130652d66dee25855ef33aba38029c4e963"} Jul 27 16:50:47.111691 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:47.111605 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" podStartSLOduration=3.111586921 podStartE2EDuration="3.111586921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:50:47.08510479 +0000 UTC m=+4.702809599" watchObservedRunningTime="2026-07-27 16:50:47.111586921 +0000 UTC m=+4.729291728" Jul 27 16:50:48.024088 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:48.023966 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:48.024579 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.024103 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:48.121035 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:48.120960 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" event={"ID":"02e347c5a565e7ca31c487460ef9125d","Type":"ContainerStarted","Data":"a6c328cf362b25a1391e6dbca9340eb9bf8ed69f5f53608413a26d60e8f6a9f2"} Jul 27 16:50:48.446790 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:48.446026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:48.446790 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:48.446082 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:48.446790 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.446245 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:48.446790 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.446309 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret podName:7aad7c5c-40cb-4533-8095-01c95334bf4f nodeName:}" failed. No retries permitted until 2026-07-27 16:50:52.446287575 +0000 UTC m=+10.063992362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret") pod "global-pull-secret-syncer-lz5dv" (UID: "7aad7c5c-40cb-4533-8095-01c95334bf4f") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:48.446790 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.446705 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:48.446790 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.446754 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs podName:8c0a30c1-ed92-447a-a426-427bdffa913b nodeName:}" failed. No retries permitted until 2026-07-27 16:50:52.446738497 +0000 UTC m=+10.064443281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs") pod "network-metrics-daemon-sjrqj" (UID: "8c0a30c1-ed92-447a-a426-427bdffa913b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:48.649056 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:48.648146 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:48.649056 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.648323 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:50:48.649056 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.648343 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:50:48.649056 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.648355 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wmkm6 for pod openshift-network-diagnostics/network-check-target-spsdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:48.649056 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:48.648427 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6 podName:9d97b403-3995-4419-8c1e-be90f78de9b0 nodeName:}" failed. No retries permitted until 2026-07-27 16:50:52.648407035 +0000 UTC m=+10.266111838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmkm6" (UniqueName: "kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6") pod "network-check-target-spsdn" (UID: "9d97b403-3995-4419-8c1e-be90f78de9b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:49.025263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:49.025228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:49.025788 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:49.025413 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:50:49.026759 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:49.025981 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:49.026759 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:49.026104 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:50.024320 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:50.024268 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:50.024504 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:50.024417 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:51.025453 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:51.024943 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:51.025453 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:51.025082 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:51.026919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:51.026077 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:51.026919 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:51.026186 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:50:52.024588 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:52.024536 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:52.024775 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.024696 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:52.484688 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:52.484599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:52.484688 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:52.484659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:52.485226 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.484786 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:52.485226 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.484797 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:52.485226 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.484877 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret podName:7aad7c5c-40cb-4533-8095-01c95334bf4f nodeName:}" failed. No retries permitted until 2026-07-27 16:51:00.484842777 +0000 UTC m=+18.102547578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret") pod "global-pull-secret-syncer-lz5dv" (UID: "7aad7c5c-40cb-4533-8095-01c95334bf4f") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:50:52.485226 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.484902 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs podName:8c0a30c1-ed92-447a-a426-427bdffa913b nodeName:}" failed. No retries permitted until 2026-07-27 16:51:00.484890509 +0000 UTC m=+18.102595297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs") pod "network-metrics-daemon-sjrqj" (UID: "8c0a30c1-ed92-447a-a426-427bdffa913b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:50:52.687304 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:52.687263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:52.687498 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.687465 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:50:52.687498 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.687485 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:50:52.687498 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.687499 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wmkm6 for pod openshift-network-diagnostics/network-check-target-spsdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:52.687656 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:52.687553 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6 podName:9d97b403-3995-4419-8c1e-be90f78de9b0 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:00.687537938 +0000 UTC m=+18.305242720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmkm6" (UniqueName: "kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6") pod "network-check-target-spsdn" (UID: "9d97b403-3995-4419-8c1e-be90f78de9b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:50:53.025453 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:53.025416 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:53.025676 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:53.025555 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:53.026020 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:53.025994 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:53.026162 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:53.026094 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:50:54.024539 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:54.024495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:54.024997 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:54.024630 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:55.025183 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:55.024452 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:55.025183 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:55.024589 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:50:55.025183 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:55.024979 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:55.025183 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:55.025100 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:56.023995 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:56.023954 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:56.024159 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:56.024104 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:57.024244 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:57.024214 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:57.024586 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:57.024345 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:50:57.024586 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:57.024389 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:57.024586 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:57.024485 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:58.024457 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:58.024418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:50:58.024940 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:58.024546 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:50:59.024286 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:59.024246 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:50:59.024443 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:59.024379 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:50:59.024643 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:50:59.024247 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:50:59.024643 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:50:59.024614 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:00.024389 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:00.024355 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:00.024607 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.024484 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:00.547041 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:00.547000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:00.547477 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:00.547053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:00.547477 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.547170 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:51:00.547477 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.547232 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret podName:7aad7c5c-40cb-4533-8095-01c95334bf4f nodeName:}" failed. No retries permitted until 2026-07-27 16:51:16.54721353 +0000 UTC m=+34.164918315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret") pod "global-pull-secret-syncer-lz5dv" (UID: "7aad7c5c-40cb-4533-8095-01c95334bf4f") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:51:00.547477 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.547171 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:51:00.547477 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.547349 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs podName:8c0a30c1-ed92-447a-a426-427bdffa913b nodeName:}" failed. No retries permitted until 2026-07-27 16:51:16.547325422 +0000 UTC m=+34.165030225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs") pod "network-metrics-daemon-sjrqj" (UID: "8c0a30c1-ed92-447a-a426-427bdffa913b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:51:00.748507 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:00.748466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:00.748666 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.748610 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:51:00.748666 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.748631 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:51:00.748666 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.748644 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wmkm6 for pod openshift-network-diagnostics/network-check-target-spsdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:51:00.748835 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:00.748725 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6 podName:9d97b403-3995-4419-8c1e-be90f78de9b0 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:16.748705831 +0000 UTC m=+34.366410614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmkm6" (UniqueName: "kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6") pod "network-check-target-spsdn" (UID: "9d97b403-3995-4419-8c1e-be90f78de9b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:51:01.023623 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:01.023587 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:01.023793 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:01.023728 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:01.023793 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:01.023780 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:01.023936 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:01.023908 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:02.024032 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:02.023998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:02.024430 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:02.024113 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:03.024797 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:03.024758 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:03.025295 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:03.024902 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:03.025295 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:03.024973 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:03.025295 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:03.025084 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:04.023990 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:04.023957 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:04.024163 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:04.024080 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:05.025687 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.024937 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:05.025687 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:05.025085 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:05.025687 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.025458 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:05.025687 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:05.025545 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:05.164120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.163255 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" event={"ID":"d5112f20-537d-43db-942a-99bce84e90e4","Type":"ContainerStarted","Data":"80d359a2a835b221b782a675e012830ea46b4e17142162ddb2b1c7e4d11308ec"} Jul 27 16:51:05.165762 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.165708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whfns" event={"ID":"2f97815a-35d9-470a-a9c9-1ee7af844642","Type":"ContainerStarted","Data":"ea3a767ea92b7ad8c8d17c1ecb1b1835704f10dcea17bde730e1ad3db7498c4f"} Jul 27 16:51:05.169383 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.169293 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jl7pk" event={"ID":"33972e58-fe51-4593-96fa-06b5e7b11b30","Type":"ContainerStarted","Data":"78b3441baf2370048fe7fd3a0b0743632670e4016c9d2ef8a215d6069d2e5219"} Jul 27 16:51:05.171446 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.171426 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerStarted","Data":"5e6b140ceabfb1586176cfbd98b0a2e4bec304304d5e5d7f58c2497f2691d2ac"} Jul 27 16:51:05.173591 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.173571 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"98d8595a4839c8d794fa1a3cfb9014bf7bf0cbc1f9d087b5f0ded098246b3b88"} Jul 27 16:51:05.178945 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.178369 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgqp4" event={"ID":"cfde1ed1-7432-442b-afb4-bac9db6017ef","Type":"ContainerStarted","Data":"516fff04823f63ef9a1ec944e970936a5faf126ac568f0b112fedc1f74d24b51"} Jul 27 16:51:05.180435 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.180387 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-whfns" podStartSLOduration=3.39874967 podStartE2EDuration="22.180371231s" totalImagesPullingTime="18.781621561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:05.179659579 +0000 UTC m=+22.797364394" watchObservedRunningTime="2026-07-27 16:51:05.180371231 +0000 UTC m=+22.798076033" Jul 27 16:51:05.180540 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.180489 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" podStartSLOduration=21.180480144 podStartE2EDuration="21.180480144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:50:48.138784395 +0000 UTC m=+5.756489202" watchObservedRunningTime="2026-07-27 16:51:05.180480144 +0000 UTC m=+22.798184947" Jul 27 16:51:05.182873 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.182316 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hhqxq" event={"ID":"4aa87403-1a29-4193-9948-c9805d93f3a8","Type":"ContainerStarted","Data":"fe11bb500878f9bb9172145a5f6ad6e13a000a0a546136f1c9e4651b7d083f19"} Jul 27 16:51:05.184116 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.184091 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7654" event={"ID":"4e7d0917-8d76-4bed-b352-3c2d0fde827a","Type":"ContainerStarted","Data":"53e9355e1779c35a07148323f5faf76d2ee5c8f6ea7ba64cb19873b8d43c0ca2"} Jul 27 16:51:05.218136 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.218063 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jl7pk" podStartSLOduration=3.348573708 podStartE2EDuration="22.218044179s" totalImagesPullingTime="18.869470471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:05.196160766 +0000 UTC m=+22.813865569" watchObservedRunningTime="2026-07-27 16:51:05.218044179 +0000 UTC m=+22.835748982" Jul 27 16:51:05.247787 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.247736 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sgqp4" podStartSLOduration=10.202967422 podStartE2EDuration="21.247715069s" totalImagesPullingTime="11.044747647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:05.230607257 +0000 UTC m=+22.848312070" watchObservedRunningTime="2026-07-27 16:51:05.247715069 +0000 UTC m=+22.865419905" Jul 27 16:51:05.247919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.247886 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hhqxq" podStartSLOduration=2.436340448 podStartE2EDuration="21.247876099s" totalImagesPullingTime="18.811535651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:05.247169145 +0000 UTC m=+22.864873972" watchObservedRunningTime="2026-07-27 16:51:05.247876099 +0000 UTC m=+22.865580901" Jul 27 16:51:05.262079 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.261908 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g7654" podStartSLOduration=2.4222607 podStartE2EDuration="21.261898031s" totalImagesPullingTime="18.839637331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:05.261779299 +0000 UTC m=+22.879484130" watchObservedRunningTime="2026-07-27 16:51:05.261898031 +0000 UTC m=+22.879602976" Jul 27 16:51:05.876722 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.876682 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:51:05.877296 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:05.877265 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:51:06.024416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.024387 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:06.024583 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:06.024488 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:06.187655 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.187621 2582 generic.go:356] "Generic (PLEG): container finished" podID="60c6ae70-8209-4710-89ab-b4844f954466" containerID="5e6b140ceabfb1586176cfbd98b0a2e4bec304304d5e5d7f58c2497f2691d2ac" exitCode=0 Jul 27 16:51:06.188486 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.187701 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerDied","Data":"5e6b140ceabfb1586176cfbd98b0a2e4bec304304d5e5d7f58c2497f2691d2ac"} Jul 27 16:51:06.191060 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.191036 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"63bd2adcc2bab522ccfa1a2a7168d2e4656fc1e81fa9f596956b5d2fa38d61b1"} Jul 27 16:51:06.191163 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.191121 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"7fff53d145ed5a5a24df4d30258292e66a8b60959db8a74b3e8f0cfc476dfad0"} Jul 27 16:51:06.191233 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.191218 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"8977bf22eff8c8d72de979ae54ae6d1a9ff3423f94374aed77e9c544604b132e"} Jul 27 16:51:06.191287 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.191278 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"c778fa9a7c2974ae2c4794691282188471138eb405fcbb8f7621b222096786df"} Jul 27 16:51:06.191337 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.191330 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"db3f3286ffe1b1ff6d40e4bed3c0c1aeda801af6b24e0af2e1c239fa33f3a117"} Jul 27 16:51:06.191633 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.191597 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:51:06.191911 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.191894 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sgqp4" Jul 27 16:51:06.469412 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.469392 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 16:51:06.869212 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.869113 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T16:51:06.469406672Z","UUID":"e4945c1a-4a57-4a91-ac48-7772db54b67e","Handler":null,"Name":"","Endpoint":""} Jul 27 16:51:06.870800 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.870773 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 16:51:06.870937 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:06.870840 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 16:51:07.024128 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:07.024068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:07.024361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:07.024068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:07.024361 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:07.024202 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:07.024361 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:07.024310 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:07.194561 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:07.194463 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lck79" event={"ID":"388fa658-3a4d-49e6-b70e-2088f86f68ad","Type":"ContainerStarted","Data":"47cfd093b0e0f4f90ca6a31bdbb4494231f56449d80260617cce52bcf36e22e6"} Jul 27 16:51:07.196517 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:07.196458 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" event={"ID":"d5112f20-537d-43db-942a-99bce84e90e4","Type":"ContainerStarted","Data":"152289e7636ca9b2aa568b8328827d530511fc87cfdd472e1046a09fcaf7f8eb"} Jul 27 16:51:07.208931 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:07.208890 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lck79" podStartSLOduration=4.422119444 podStartE2EDuration="23.20887721s" totalImagesPullingTime="18.786757766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:07.208381128 +0000 UTC m=+24.826085933" watchObservedRunningTime="2026-07-27 16:51:07.20887721 +0000 UTC m=+24.826582011" Jul 27 16:51:08.024458 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:08.024388 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:08.024709 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:08.024496 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:08.203378 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:08.203337 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"3e224aa2ee6025ccb379c74f628e00dd98704d9cc029ca7e68e1ec099a0a8cec"} Jul 27 16:51:08.206606 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:08.206576 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" event={"ID":"d5112f20-537d-43db-942a-99bce84e90e4","Type":"ContainerStarted","Data":"369ac1ca45be017f65b130ffa717ca2b3f0a648f177f9c63792ab1f306e8a079"} Jul 27 16:51:08.228036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:08.227983 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmq29" podStartSLOduration=3.006477409 podStartE2EDuration="24.227969909s" totalImagesPullingTime="21.2214925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:08.227464386 +0000 UTC m=+25.845169189" watchObservedRunningTime="2026-07-27 16:51:08.227969909 +0000 UTC m=+25.845674711" Jul 27 16:51:09.024758 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:09.024540 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:09.025055 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:09.024615 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:09.025055 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:09.024879 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:09.025055 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:09.024936 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:10.024282 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:10.024248 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:10.024647 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:10.024386 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:11.027627 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.027382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:11.027627 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.027404 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:11.028204 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:11.027635 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:11.028204 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:11.027680 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:11.215477 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.215447 2582 generic.go:356] "Generic (PLEG): container finished" podID="60c6ae70-8209-4710-89ab-b4844f954466" containerID="e34afcdc413a0537429fd83f527ff4d8256636901e4974ace72f7cf3a7b584a1" exitCode=0 Jul 27 16:51:11.215642 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.215520 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerDied","Data":"e34afcdc413a0537429fd83f527ff4d8256636901e4974ace72f7cf3a7b584a1"} Jul 27 16:51:11.219114 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.219090 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" event={"ID":"63936cfb-9df8-40a1-86c6-9d08390b1e0e","Type":"ContainerStarted","Data":"9470bb0630c7316fde7f923d1de95dfd2fc39b17e1ccf7ab15e8f8fee6e1c851"} Jul 27 16:51:11.219395 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.219373 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:51:11.234919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.234890 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:51:11.266779 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:11.266733 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" podStartSLOduration=8.398536485 podStartE2EDuration="27.266719727s" totalImagesPullingTime="18.868183242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:11.265588731 +0000 UTC m=+28.883293544" watchObservedRunningTime="2026-07-27 16:51:11.266719727 +0000 UTC m=+28.884424528" Jul 27 16:51:12.023708 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.023677 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:12.023907 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:12.023789 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:12.221979 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.221950 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:51:12.222320 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.222021 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:51:12.239041 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.239017 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:51:12.376081 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.376050 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lz5dv"] Jul 27 16:51:12.376211 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.376181 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:12.376295 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:12.376269 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:12.381971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.381946 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-spsdn"] Jul 27 16:51:12.382087 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.382054 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:12.382176 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:12.382153 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:12.389647 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.389620 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sjrqj"] Jul 27 16:51:12.389744 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:12.389735 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:12.389875 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:12.389854 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:13.226109 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:13.226069 2582 generic.go:356] "Generic (PLEG): container finished" podID="60c6ae70-8209-4710-89ab-b4844f954466" containerID="c73c91c498ed37db0e7443664cfab5378605cfe9e75ee6aa38e91bc61b5f0de5" exitCode=0 Jul 27 16:51:13.226597 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:13.226146 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerDied","Data":"c73c91c498ed37db0e7443664cfab5378605cfe9e75ee6aa38e91bc61b5f0de5"} Jul 27 16:51:14.024067 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:14.024032 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:14.024182 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:14.024137 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:14.024182 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:14.024147 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:14.024182 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:14.024165 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:14.024279 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:14.024248 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:14.024333 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:14.024316 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:15.231977 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:15.231780 2582 generic.go:356] "Generic (PLEG): container finished" podID="60c6ae70-8209-4710-89ab-b4844f954466" containerID="a08d5fb6848286a4fe95c775ca07ab8626195dace1dc4b26d9f2c9fa2e51ccc0" exitCode=0 Jul 27 16:51:15.232377 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:15.231855 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerDied","Data":"a08d5fb6848286a4fe95c775ca07ab8626195dace1dc4b26d9f2c9fa2e51ccc0"} Jul 27 16:51:16.024031 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:16.023998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:16.024187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:16.024002 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:16.024187 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.024094 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spsdn" podUID="9d97b403-3995-4419-8c1e-be90f78de9b0" Jul 27 16:51:16.024258 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.024184 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lz5dv" podUID="7aad7c5c-40cb-4533-8095-01c95334bf4f" Jul 27 16:51:16.024258 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:16.024002 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:16.024320 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.024265 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sjrqj" podUID="8c0a30c1-ed92-447a-a426-427bdffa913b" Jul 27 16:51:16.563042 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:16.562998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:16.563042 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:16.563045 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:16.563455 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.563129 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:51:16.563455 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.563131 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:51:16.563455 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.563177 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret podName:7aad7c5c-40cb-4533-8095-01c95334bf4f nodeName:}" failed. No retries permitted until 2026-07-27 16:51:48.563164603 +0000 UTC m=+66.180869384 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret") pod "global-pull-secret-syncer-lz5dv" (UID: "7aad7c5c-40cb-4533-8095-01c95334bf4f") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:51:16.563455 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.563190 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs podName:8c0a30c1-ed92-447a-a426-427bdffa913b nodeName:}" failed. No retries permitted until 2026-07-27 16:51:48.563184195 +0000 UTC m=+66.180888975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs") pod "network-metrics-daemon-sjrqj" (UID: "8c0a30c1-ed92-447a-a426-427bdffa913b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:51:16.764389 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:16.764358 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:16.764550 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.764477 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:51:16.764550 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.764492 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:51:16.764550 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.764500 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wmkm6 for pod openshift-network-diagnostics/network-check-target-spsdn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:51:16.764550 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:16.764544 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6 podName:9d97b403-3995-4419-8c1e-be90f78de9b0 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:48.764531135 +0000 UTC m=+66.382235915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmkm6" (UniqueName: "kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6") pod "network-check-target-spsdn" (UID: "9d97b403-3995-4419-8c1e-be90f78de9b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:51:17.656108 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.656084 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeReady" Jul 27 16:51:17.656664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.656256 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 16:51:17.704239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.704199 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v"] Jul 27 16:51:17.710849 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.710116 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74bb6776d4-5pm8p"] Jul 27 16:51:17.710849 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.710238 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:17.712085 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.712059 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4"] Jul 27 16:51:17.712568 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.712547 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.712997 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.712971 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.713277 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.713254 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.713388 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.713371 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rpnv7\"" Jul 27 16:51:17.713896 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.713857 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hsfsj"] Jul 27 16:51:17.714008 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.713907 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 27 16:51:17.714008 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.713998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.715699 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.715676 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-64gq6"] Jul 27 16:51:17.715901 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.715879 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6kbc\"" Jul 27 16:51:17.716007 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.715911 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.716007 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.715958 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 27 16:51:17.716120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.716077 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 16:51:17.716542 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.716496 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 16:51:17.716628 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.716546 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.716735 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.716580 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 16:51:17.717508 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.717488 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm"] Jul 27 16:51:17.717630 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.717615 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.718615 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.718501 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8b896\"" Jul 27 16:51:17.718615 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.718600 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.718899 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.718724 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 27 16:51:17.719196 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.719159 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl"] Jul 27 16:51:17.719286 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.719231 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.721181 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.721161 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.721856 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.721780 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.722322 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.722302 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd"] Jul 27 16:51:17.722722 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.722700 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.722722 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.722717 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 27 16:51:17.722892 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.722776 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 16:51:17.722984 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.722963 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 27 16:51:17.723110 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723030 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.723110 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723038 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.723110 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723052 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 27 16:51:17.723110 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.722970 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 27 16:51:17.723477 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.722974 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 27 16:51:17.723477 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723193 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 27 16:51:17.723477 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723223 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" Jul 27 16:51:17.723477 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723336 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.723715 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723514 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fwtgw\"" Jul 27 16:51:17.723904 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723885 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pgttp\"" Jul 27 16:51:17.723990 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.723974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qrm6z\"" Jul 27 16:51:17.724381 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.724358 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-646b69665-d6chx"] Jul 27 16:51:17.724633 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.724614 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.726565 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.726546 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.727430 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.727412 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.729654 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.729273 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v"] Jul 27 16:51:17.730482 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.730444 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.731206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.731185 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.731647 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.731629 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 27 16:51:17.731757 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.731742 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.731847 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.731833 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 27 16:51:17.732037 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.732023 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 27 16:51:17.732184 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.732170 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 27 16:51:17.732361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.732343 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xdbq2\"" Jul 27 16:51:17.732853 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.732834 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.733405 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.733385 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 27 16:51:17.736640 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.735918 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 27 16:51:17.737233 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.736696 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h4mhp\"" Jul 27 16:51:17.738069 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.738050 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4"] Jul 27 16:51:17.739014 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.738996 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s4r7m\"" Jul 27 16:51:17.739185 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.739160 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-64gq6"] Jul 27 16:51:17.739481 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.739465 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 27 16:51:17.739753 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.739501 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.740930 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.740909 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 27 16:51:17.741012 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.740983 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl"] Jul 27 16:51:17.743010 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.742987 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-646b69665-d6chx"] Jul 27 16:51:17.744548 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.744528 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hsfsj"] Jul 27 16:51:17.746515 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.746496 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm"] Jul 27 16:51:17.746630 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.746539 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7"] Jul 27 16:51:17.748978 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.748959 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4t58r"] Jul 27 16:51:17.749492 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.749476 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" Jul 27 16:51:17.751875 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.751852 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74bb6776d4-5pm8p"] Jul 27 16:51:17.751966 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.751891 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l2t2p"] Jul 27 16:51:17.751966 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.751894 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.752339 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.752325 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.752737 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.752721 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-n5tks\"" Jul 27 16:51:17.753035 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.753019 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.753659 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.753640 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:17.754255 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.754238 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 16:51:17.754344 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.754240 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tkpjp\"" Jul 27 16:51:17.754613 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.754589 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 16:51:17.755598 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.755579 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7"] Jul 27 16:51:17.756191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.756173 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h8f9b\"" Jul 27 16:51:17.756293 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.756225 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 16:51:17.756409 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.755834 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 16:51:17.756538 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.756404 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 16:51:17.760029 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.760007 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd"] Jul 27 16:51:17.761270 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.761248 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4t58r"] Jul 27 16:51:17.761971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.761953 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l2t2p"] Jul 27 16:51:17.871550 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871516 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-serving-cert\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.871712 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.871712 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-config\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.871712 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/002fff69-43cb-4b5f-974a-62723949be11-cert\") pod \"ingress-canary-l2t2p\" (UID: \"002fff69-43cb-4b5f-974a-62723949be11\") " pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:17.871712 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871678 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-trusted-ca\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.871712 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f71bdb77-5c80-44eb-be60-d16602467705-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.871971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnf2s\" (UniqueName: \"kubernetes.io/projected/5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec-kube-api-access-bnf2s\") pod \"volume-data-source-validator-549c6d54cf-cp4jl\" (UID: \"5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" Jul 27 16:51:17.871971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b45b08f-5c6e-4445-8745-646eb7af6e34-service-ca-bundle\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.871971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871830 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b45b08f-5c6e-4445-8745-646eb7af6e34-serving-cert\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.871971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871872 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b45b08f-5c6e-4445-8745-646eb7af6e34-tmp\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.871971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f71bdb77-5c80-44eb-be60-d16602467705-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.871971 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:17.872249 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.871983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.872249 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5rnr\" (UniqueName: \"kubernetes.io/projected/156d3618-4e03-48d3-8457-c797d18b808d-kube-api-access-m5rnr\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.872249 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/156d3618-4e03-48d3-8457-c797d18b808d-config\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.872249 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872200 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qf8\" (UniqueName: \"kubernetes.io/projected/8a729f11-ce8d-4a21-ac4b-907484ec1d69-kube-api-access-v8qf8\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.872249 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872237 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jshj\" (UniqueName: \"kubernetes.io/projected/f71bdb77-5c80-44eb-be60-d16602467705-kube-api-access-2jshj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.872452 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.872452 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872313 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.872452 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872341 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-trusted-ca\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.872452 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0b45b08f-5c6e-4445-8745-646eb7af6e34-snapshots\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.872452 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872374 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97j4x\" (UniqueName: \"kubernetes.io/projected/553dba1f-63e4-47d0-92b3-a7e7736bfc54-kube-api-access-97j4x\") pod \"network-check-source-7d88cb55d8-pk2x7\" (UID: \"553dba1f-63e4-47d0-92b3-a7e7736bfc54\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" Jul 27 16:51:17.872452 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872388 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-installation-pull-secrets\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.872452 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jks2c\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-kube-api-access-jks2c\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.872667 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872458 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/674234bf-6e5b-48fa-833f-be4cb0599e62-ca-trust-extracted\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.872667 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.872667 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/156d3618-4e03-48d3-8457-c797d18b808d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.872667 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872585 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k45k\" (UniqueName: \"kubernetes.io/projected/40adc67f-064a-4b8e-b633-426d01c27cb4-kube-api-access-8k45k\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.872667 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b45b08f-5c6e-4445-8745-646eb7af6e34-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txdd8\" (UniqueName: \"kubernetes.io/projected/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-kube-api-access-txdd8\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872702 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-default-certificate\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872748 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1281ba-006c-4921-a314-33cfecf282f3-config-volume\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872791 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-image-registry-private-configuration\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj692\" (UniqueName: \"kubernetes.io/projected/0b45b08f-5c6e-4445-8745-646eb7af6e34-kube-api-access-bj692\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-bound-sa-token\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872901 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-stats-auth\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.872928 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872925 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z5rq\" (UniqueName: \"kubernetes.io/projected/002fff69-43cb-4b5f-974a-62723949be11-kube-api-access-5z5rq\") pod \"ingress-canary-l2t2p\" (UID: \"002fff69-43cb-4b5f-974a-62723949be11\") " pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:17.873302 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872943 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1281ba-006c-4921-a314-33cfecf282f3-tmp-dir\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.873302 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.872974 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmn25\" (UniqueName: \"kubernetes.io/projected/3d1281ba-006c-4921-a314-33cfecf282f3-kube-api-access-jmn25\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.873302 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.873031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l8tk\" (UniqueName: \"kubernetes.io/projected/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-kube-api-access-4l8tk\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.873302 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.873061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/40adc67f-064a-4b8e-b633-426d01c27cb4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.873302 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.873086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-certificates\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.973868 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.973759 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/156d3618-4e03-48d3-8457-c797d18b808d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.973868 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.973835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k45k\" (UniqueName: \"kubernetes.io/projected/40adc67f-064a-4b8e-b633-426d01c27cb4-kube-api-access-8k45k\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.973868 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.973865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b45b08f-5c6e-4445-8745-646eb7af6e34-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.974120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.973890 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txdd8\" (UniqueName: \"kubernetes.io/projected/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-kube-api-access-txdd8\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:17.974120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.973917 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-default-certificate\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.974120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.973942 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1281ba-006c-4921-a314-33cfecf282f3-config-volume\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.974120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.973986 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-image-registry-private-configuration\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.974120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj692\" (UniqueName: \"kubernetes.io/projected/0b45b08f-5c6e-4445-8745-646eb7af6e34-kube-api-access-bj692\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.974120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-bound-sa-token\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.974120 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-stats-auth\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z5rq\" (UniqueName: \"kubernetes.io/projected/002fff69-43cb-4b5f-974a-62723949be11-kube-api-access-5z5rq\") pod \"ingress-canary-l2t2p\" (UID: \"002fff69-43cb-4b5f-974a-62723949be11\") " pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1281ba-006c-4921-a314-33cfecf282f3-tmp-dir\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmn25\" (UniqueName: \"kubernetes.io/projected/3d1281ba-006c-4921-a314-33cfecf282f3-kube-api-access-jmn25\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l8tk\" (UniqueName: \"kubernetes.io/projected/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-kube-api-access-4l8tk\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/40adc67f-064a-4b8e-b633-426d01c27cb4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-certificates\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-serving-cert\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974369 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.974408 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974394 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-config\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974419 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/002fff69-43cb-4b5f-974a-62723949be11-cert\") pod \"ingress-canary-l2t2p\" (UID: \"002fff69-43cb-4b5f-974a-62723949be11\") " pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-trusted-ca\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f71bdb77-5c80-44eb-be60-d16602467705-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnf2s\" (UniqueName: \"kubernetes.io/projected/5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec-kube-api-access-bnf2s\") pod \"volume-data-source-validator-549c6d54cf-cp4jl\" (UID: \"5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b45b08f-5c6e-4445-8745-646eb7af6e34-service-ca-bundle\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974543 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b45b08f-5c6e-4445-8745-646eb7af6e34-serving-cert\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974570 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b45b08f-5c6e-4445-8745-646eb7af6e34-tmp\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.974583 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d1281ba-006c-4921-a314-33cfecf282f3-tmp-dir\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.974656 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.974673 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74bb6776d4-5pm8p: secret "image-registry-tls" not found Jul 27 16:51:17.974786 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.974769 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls podName:674234bf-6e5b-48fa-833f-be4cb0599e62 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:18.474745718 +0000 UTC m=+36.092450497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls") pod "image-registry-74bb6776d4-5pm8p" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62") : secret "image-registry-tls" not found Jul 27 16:51:17.975242 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975224 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f71bdb77-5c80-44eb-be60-d16602467705-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.975287 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975250 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b45b08f-5c6e-4445-8745-646eb7af6e34-tmp\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.975446 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975420 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b45b08f-5c6e-4445-8745-646eb7af6e34-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.975516 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975422 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-config\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.975516 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f71bdb77-5c80-44eb-be60-d16602467705-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.975601 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975521 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:17.975601 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.975601 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5rnr\" (UniqueName: \"kubernetes.io/projected/156d3618-4e03-48d3-8457-c797d18b808d-kube-api-access-m5rnr\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/156d3618-4e03-48d3-8457-c797d18b808d-config\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975626 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qf8\" (UniqueName: \"kubernetes.io/projected/8a729f11-ce8d-4a21-ac4b-907484ec1d69-kube-api-access-v8qf8\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975648 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jshj\" (UniqueName: \"kubernetes.io/projected/f71bdb77-5c80-44eb-be60-d16602467705-kube-api-access-2jshj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975674 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975708 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975746 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-trusted-ca\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0b45b08f-5c6e-4445-8745-646eb7af6e34-snapshots\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97j4x\" (UniqueName: \"kubernetes.io/projected/553dba1f-63e4-47d0-92b3-a7e7736bfc54-kube-api-access-97j4x\") pod \"network-check-source-7d88cb55d8-pk2x7\" (UID: \"553dba1f-63e4-47d0-92b3-a7e7736bfc54\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-installation-pull-secrets\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jks2c\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-kube-api-access-jks2c\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/674234bf-6e5b-48fa-833f-be4cb0599e62-ca-trust-extracted\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.975904 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.976002 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/40adc67f-064a-4b8e-b633-426d01c27cb4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.976022 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.976002 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-certificates\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.977187 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.976084 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls podName:3d1281ba-006c-4921-a314-33cfecf282f3 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:18.476066675 +0000 UTC m=+36.093771466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls") pod "dns-default-4t58r" (UID: "3d1281ba-006c-4921-a314-33cfecf282f3") : secret "dns-default-metrics-tls" not found Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.976101 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b45b08f-5c6e-4445-8745-646eb7af6e34-service-ca-bundle\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.976522 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1281ba-006c-4921-a314-33cfecf282f3-config-volume\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.976768 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:18.476748895 +0000 UTC m=+36.094453709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : configmap references non-existent config key: service-ca.crt Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.976922 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-trusted-ca\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.977005 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.977050 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls podName:0aa40a1c-f159-46ce-bb32-edfd76c2f4d7 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:18.477035835 +0000 UTC m=+36.094740619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls") pod "cluster-samples-operator-6748489656-dgp5v" (UID: "0aa40a1c-f159-46ce-bb32-edfd76c2f4d7") : secret "samples-operator-tls" not found Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.977005 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.977090 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls podName:40adc67f-064a-4b8e-b633-426d01c27cb4 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:18.477079648 +0000 UTC m=+36.094784432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5bjp4" (UID: "40adc67f-064a-4b8e-b633-426d01c27cb4") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.977478 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/156d3618-4e03-48d3-8457-c797d18b808d-config\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.977652 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0b45b08f-5c6e-4445-8745-646eb7af6e34-snapshots\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.977912 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-trusted-ca\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.977949 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:51:17.978002 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:17.977997 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:18.477980796 +0000 UTC m=+36.095685590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : secret "router-metrics-certs-default" not found Jul 27 16:51:17.979035 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.979008 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/674234bf-6e5b-48fa-833f-be4cb0599e62-ca-trust-extracted\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.979361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.979310 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-serving-cert\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.979516 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.979493 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-image-registry-private-configuration\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.979750 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.979729 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/156d3618-4e03-48d3-8457-c797d18b808d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.980099 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.980074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b45b08f-5c6e-4445-8745-646eb7af6e34-serving-cert\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.981122 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.981098 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/002fff69-43cb-4b5f-974a-62723949be11-cert\") pod \"ingress-canary-l2t2p\" (UID: \"002fff69-43cb-4b5f-974a-62723949be11\") " pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:17.981231 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.981170 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-stats-auth\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.981367 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.981345 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f71bdb77-5c80-44eb-be60-d16602467705-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:17.981613 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.981592 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-default-certificate\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.982103 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.982081 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-installation-pull-secrets\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.989032 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.988998 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k45k\" (UniqueName: \"kubernetes.io/projected/40adc67f-064a-4b8e-b633-426d01c27cb4-kube-api-access-8k45k\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:17.991980 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.991806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-bound-sa-token\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.992413 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.992376 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jks2c\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-kube-api-access-jks2c\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:17.994000 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.993970 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnf2s\" (UniqueName: \"kubernetes.io/projected/5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec-kube-api-access-bnf2s\") pod \"volume-data-source-validator-549c6d54cf-cp4jl\" (UID: \"5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" Jul 27 16:51:17.994762 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.994736 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qf8\" (UniqueName: \"kubernetes.io/projected/8a729f11-ce8d-4a21-ac4b-907484ec1d69-kube-api-access-v8qf8\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:17.994871 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.994773 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l8tk\" (UniqueName: \"kubernetes.io/projected/38702e26-d8ec-428d-ad54-5b4fc3a6b1f9-kube-api-access-4l8tk\") pod \"console-operator-584dcb6b54-64gq6\" (UID: \"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9\") " pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:17.994871 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.994779 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z5rq\" (UniqueName: \"kubernetes.io/projected/002fff69-43cb-4b5f-974a-62723949be11-kube-api-access-5z5rq\") pod \"ingress-canary-l2t2p\" (UID: \"002fff69-43cb-4b5f-974a-62723949be11\") " pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:17.994871 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.994785 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txdd8\" (UniqueName: \"kubernetes.io/projected/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-kube-api-access-txdd8\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:17.995042 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.994957 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97j4x\" (UniqueName: \"kubernetes.io/projected/553dba1f-63e4-47d0-92b3-a7e7736bfc54-kube-api-access-97j4x\") pod \"network-check-source-7d88cb55d8-pk2x7\" (UID: \"553dba1f-63e4-47d0-92b3-a7e7736bfc54\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" Jul 27 16:51:17.995042 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.994998 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj692\" (UniqueName: \"kubernetes.io/projected/0b45b08f-5c6e-4445-8745-646eb7af6e34-kube-api-access-bj692\") pod \"insights-operator-5885fdb759-hsfsj\" (UID: \"0b45b08f-5c6e-4445-8745-646eb7af6e34\") " pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:17.995187 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.995170 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5rnr\" (UniqueName: \"kubernetes.io/projected/156d3618-4e03-48d3-8457-c797d18b808d-kube-api-access-m5rnr\") pod \"service-ca-operator-5d6c75f84f-7tprd\" (UID: \"156d3618-4e03-48d3-8457-c797d18b808d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:17.995476 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.995432 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmn25\" (UniqueName: \"kubernetes.io/projected/3d1281ba-006c-4921-a314-33cfecf282f3-kube-api-access-jmn25\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:17.996643 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:17.996619 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jshj\" (UniqueName: \"kubernetes.io/projected/f71bdb77-5c80-44eb-be60-d16602467705-kube-api-access-2jshj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm\" (UID: \"f71bdb77-5c80-44eb-be60-d16602467705\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:18.024041 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.024007 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:18.024205 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.024120 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:18.024205 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.024151 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:18.027267 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.027243 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 16:51:18.027379 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.027253 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5hns5\"" Jul 27 16:51:18.027379 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.027327 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 16:51:18.027553 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.027539 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86zvt\"" Jul 27 16:51:18.042664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.042642 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hsfsj" Jul 27 16:51:18.071309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.071263 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:18.076948 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.076922 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" Jul 27 16:51:18.085310 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.085051 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" Jul 27 16:51:18.091472 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.091292 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" Jul 27 16:51:18.106184 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.106078 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" Jul 27 16:51:18.119943 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.119695 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l2t2p" Jul 27 16:51:18.311560 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.311461 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hsfsj"] Jul 27 16:51:18.321039 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:18.317628 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b45b08f_5c6e_4445_8745_646eb7af6e34.slice/crio-33df093105cb8f71bf72d68ed0fdaa0ecc43bc7ee295338542cd5434616b78bb WatchSource:0}: Error finding container 33df093105cb8f71bf72d68ed0fdaa0ecc43bc7ee295338542cd5434616b78bb: Status 404 returned error can't find the container with id 33df093105cb8f71bf72d68ed0fdaa0ecc43bc7ee295338542cd5434616b78bb Jul 27 16:51:18.356933 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.356902 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm"] Jul 27 16:51:18.362006 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.360895 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-64gq6"] Jul 27 16:51:18.362006 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.361236 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl"] Jul 27 16:51:18.362935 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:18.362869 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71bdb77_5c80_44eb_be60_d16602467705.slice/crio-85820cedccbd2f66607cc2bbc691964d14ecf1ab51032499b69662abf4da9e5b WatchSource:0}: Error finding container 85820cedccbd2f66607cc2bbc691964d14ecf1ab51032499b69662abf4da9e5b: Status 404 returned error can't find the container with id 85820cedccbd2f66607cc2bbc691964d14ecf1ab51032499b69662abf4da9e5b Jul 27 16:51:18.368472 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:18.368444 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4e5c70_6a55_4c25_ab43_bbb16a01d7ec.slice/crio-7a985b4efbd64f8dcd6c633380d690f88ed05b644bbd2604a501cc4b2c03d39c WatchSource:0}: Error finding container 7a985b4efbd64f8dcd6c633380d690f88ed05b644bbd2604a501cc4b2c03d39c: Status 404 returned error can't find the container with id 7a985b4efbd64f8dcd6c633380d690f88ed05b644bbd2604a501cc4b2c03d39c Jul 27 16:51:18.368802 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:18.368782 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38702e26_d8ec_428d_ad54_5b4fc3a6b1f9.slice/crio-40f5f7175e26d3900c8ff92a2a6356b75f7ad16e1f974f4e2f5f13dc1db4359b WatchSource:0}: Error finding container 40f5f7175e26d3900c8ff92a2a6356b75f7ad16e1f974f4e2f5f13dc1db4359b: Status 404 returned error can't find the container with id 40f5f7175e26d3900c8ff92a2a6356b75f7ad16e1f974f4e2f5f13dc1db4359b Jul 27 16:51:18.373522 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.373499 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd"] Jul 27 16:51:18.375851 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:18.375811 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156d3618_4e03_48d3_8457_c797d18b808d.slice/crio-013097b2f5f6e4f06e21c0a9c5b6d446f2664f5aa0329aa5d9b6c0a7e87030c7 WatchSource:0}: Error finding container 013097b2f5f6e4f06e21c0a9c5b6d446f2664f5aa0329aa5d9b6c0a7e87030c7: Status 404 returned error can't find the container with id 013097b2f5f6e4f06e21c0a9c5b6d446f2664f5aa0329aa5d9b6c0a7e87030c7 Jul 27 16:51:18.379346 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.379325 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7"] Jul 27 16:51:18.382353 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:18.382330 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553dba1f_63e4_47d0_92b3_a7e7736bfc54.slice/crio-c8a80266b190303631a61bdc1a7160274479b3889527350c8c25d8944f9ae57e WatchSource:0}: Error finding container c8a80266b190303631a61bdc1a7160274479b3889527350c8c25d8944f9ae57e: Status 404 returned error can't find the container with id c8a80266b190303631a61bdc1a7160274479b3889527350c8c25d8944f9ae57e Jul 27 16:51:18.385606 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.385587 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l2t2p"] Jul 27 16:51:18.388889 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:18.388871 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002fff69_43cb_4b5f_974a_62723949be11.slice/crio-210fab1c013915c7b7e527ec809fd4c0d056c59b7edb7aa192929425e4bb2115 WatchSource:0}: Error finding container 210fab1c013915c7b7e527ec809fd4c0d056c59b7edb7aa192929425e4bb2115: Status 404 returned error can't find the container with id 210fab1c013915c7b7e527ec809fd4c0d056c59b7edb7aa192929425e4bb2115 Jul 27 16:51:18.480765 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.480726 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:18.480944 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.480846 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:18.480944 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.480892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:18.480944 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.480892 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:51:18.480944 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.480939 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74bb6776d4-5pm8p: secret "image-registry-tls" not found Jul 27 16:51:18.481118 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.480956 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:51:18.481118 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.480993 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls podName:674234bf-6e5b-48fa-833f-be4cb0599e62 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:19.480975986 +0000 UTC m=+37.098680766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls") pod "image-registry-74bb6776d4-5pm8p" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62") : secret "image-registry-tls" not found Jul 27 16:51:18.481118 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481002 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:18.481118 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481019 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls podName:0aa40a1c-f159-46ce-bb32-edfd76c2f4d7 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:19.481000295 +0000 UTC m=+37.098705078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls") pod "cluster-samples-operator-6748489656-dgp5v" (UID: "0aa40a1c-f159-46ce-bb32-edfd76c2f4d7") : secret "samples-operator-tls" not found Jul 27 16:51:18.481118 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481064 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls podName:40adc67f-064a-4b8e-b633-426d01c27cb4 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:19.481049044 +0000 UTC m=+37.098753839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5bjp4" (UID: "40adc67f-064a-4b8e-b633-426d01c27cb4") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:18.481118 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.481090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:18.481389 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.481134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:18.481389 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481166 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:19.481153804 +0000 UTC m=+37.098858600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : configmap references non-existent config key: service-ca.crt Jul 27 16:51:18.481389 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481212 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:51:18.481389 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481254 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:19.481242815 +0000 UTC m=+37.098947600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : secret "router-metrics-certs-default" not found Jul 27 16:51:18.481389 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:18.481208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:18.481389 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481268 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:51:18.481389 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:18.481302 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls podName:3d1281ba-006c-4921-a314-33cfecf282f3 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:19.481292758 +0000 UTC m=+37.098997548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls") pod "dns-default-4t58r" (UID: "3d1281ba-006c-4921-a314-33cfecf282f3") : secret "dns-default-metrics-tls" not found Jul 27 16:51:19.249284 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.249199 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" event={"ID":"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9","Type":"ContainerStarted","Data":"40f5f7175e26d3900c8ff92a2a6356b75f7ad16e1f974f4e2f5f13dc1db4359b"} Jul 27 16:51:19.252658 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.252622 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hsfsj" event={"ID":"0b45b08f-5c6e-4445-8745-646eb7af6e34","Type":"ContainerStarted","Data":"33df093105cb8f71bf72d68ed0fdaa0ecc43bc7ee295338542cd5434616b78bb"} Jul 27 16:51:19.256944 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.256910 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" event={"ID":"f71bdb77-5c80-44eb-be60-d16602467705","Type":"ContainerStarted","Data":"85820cedccbd2f66607cc2bbc691964d14ecf1ab51032499b69662abf4da9e5b"} Jul 27 16:51:19.258977 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.258914 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" event={"ID":"156d3618-4e03-48d3-8457-c797d18b808d","Type":"ContainerStarted","Data":"013097b2f5f6e4f06e21c0a9c5b6d446f2664f5aa0329aa5d9b6c0a7e87030c7"} Jul 27 16:51:19.261751 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.261658 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l2t2p" event={"ID":"002fff69-43cb-4b5f-974a-62723949be11","Type":"ContainerStarted","Data":"210fab1c013915c7b7e527ec809fd4c0d056c59b7edb7aa192929425e4bb2115"} Jul 27 16:51:19.264952 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.264874 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" event={"ID":"5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec","Type":"ContainerStarted","Data":"7a985b4efbd64f8dcd6c633380d690f88ed05b644bbd2604a501cc4b2c03d39c"} Jul 27 16:51:19.267977 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.267911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" event={"ID":"553dba1f-63e4-47d0-92b3-a7e7736bfc54","Type":"ContainerStarted","Data":"c8a80266b190303631a61bdc1a7160274479b3889527350c8c25d8944f9ae57e"} Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.491971 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.492041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.492073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.492110 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.492143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:19.492184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.492329 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.492395 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls podName:3d1281ba-006c-4921-a314-33cfecf282f3 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:21.492374861 +0000 UTC m=+39.110079667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls") pod "dns-default-4t58r" (UID: "3d1281ba-006c-4921-a314-33cfecf282f3") : secret "dns-default-metrics-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.492861 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.492877 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74bb6776d4-5pm8p: secret "image-registry-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.492924 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls podName:674234bf-6e5b-48fa-833f-be4cb0599e62 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:21.492908824 +0000 UTC m=+39.110613626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls") pod "image-registry-74bb6776d4-5pm8p" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62") : secret "image-registry-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.492991 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.493025 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls podName:0aa40a1c-f159-46ce-bb32-edfd76c2f4d7 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:21.493014333 +0000 UTC m=+39.110719128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls") pod "cluster-samples-operator-6748489656-dgp5v" (UID: "0aa40a1c-f159-46ce-bb32-edfd76c2f4d7") : secret "samples-operator-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.493081 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:19.493306 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.493112 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls podName:40adc67f-064a-4b8e-b633-426d01c27cb4 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:21.493101912 +0000 UTC m=+39.110806694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5bjp4" (UID: "40adc67f-064a-4b8e-b633-426d01c27cb4") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:19.494252 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.493176 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:21.493166571 +0000 UTC m=+39.110871354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : configmap references non-existent config key: service-ca.crt Jul 27 16:51:19.494252 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.493235 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:51:19.494252 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:19.493264 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:21.493253721 +0000 UTC m=+39.110958504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : secret "router-metrics-certs-default" not found Jul 27 16:51:21.515310 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:21.515269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:21.515322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:21.515415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515441 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515463 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74bb6776d4-5pm8p: secret "image-registry-tls" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:21.515480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515517 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515525 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls podName:674234bf-6e5b-48fa-833f-be4cb0599e62 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:25.515505386 +0000 UTC m=+43.133210175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls") pod "image-registry-74bb6776d4-5pm8p" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62") : secret "image-registry-tls" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:21.515550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515564 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls podName:0aa40a1c-f159-46ce-bb32-edfd76c2f4d7 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:25.515550812 +0000 UTC m=+43.133255596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls") pod "cluster-samples-operator-6748489656-dgp5v" (UID: "0aa40a1c-f159-46ce-bb32-edfd76c2f4d7") : secret "samples-operator-tls" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515585 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515601 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:25.515585536 +0000 UTC m=+43.133290322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : configmap references non-existent config key: service-ca.crt Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515608 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515634 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls podName:40adc67f-064a-4b8e-b633-426d01c27cb4 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:25.515619383 +0000 UTC m=+43.133324178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5bjp4" (UID: "40adc67f-064a-4b8e-b633-426d01c27cb4") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:21.515656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515731 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:25.515723497 +0000 UTC m=+43.133428276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : secret "router-metrics-certs-default" not found Jul 27 16:51:21.515849 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515760 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:51:21.516460 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:21.515798 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls podName:3d1281ba-006c-4921-a314-33cfecf282f3 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:25.515784558 +0000 UTC m=+43.133489343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls") pod "dns-default-4t58r" (UID: "3d1281ba-006c-4921-a314-33cfecf282f3") : secret "dns-default-metrics-tls" not found Jul 27 16:51:24.692667 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.692636 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk"] Jul 27 16:51:24.707920 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.707894 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk"] Jul 27 16:51:24.708059 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.707989 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:24.710189 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.710158 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 27 16:51:24.710189 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.710182 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 27 16:51:24.710377 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.710185 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-smp2w\"" Jul 27 16:51:24.851514 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.851472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3180b606-4ae9-47cf-95a2-5886a3013e08-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:24.851709 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.851648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:24.952537 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.952446 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:24.952537 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.952520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3180b606-4ae9-47cf-95a2-5886a3013e08-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:24.952742 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:24.952608 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:51:24.952742 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:24.952698 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert podName:3180b606-4ae9-47cf-95a2-5886a3013e08 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:25.452665701 +0000 UTC m=+43.070370509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gpqhk" (UID: "3180b606-4ae9-47cf-95a2-5886a3013e08") : secret "networking-console-plugin-cert" not found Jul 27 16:51:24.953383 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:24.953359 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3180b606-4ae9-47cf-95a2-5886a3013e08-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:25.458209 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:25.458170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:25.458367 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.458326 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:51:25.458406 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.458394 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert podName:3180b606-4ae9-47cf-95a2-5886a3013e08 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:26.458378807 +0000 UTC m=+44.076083586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gpqhk" (UID: "3180b606-4ae9-47cf-95a2-5886a3013e08") : secret "networking-console-plugin-cert" not found Jul 27 16:51:25.559514 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:25.559479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:25.559652 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:25.559525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:25.559652 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:25.559543 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:25.559652 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:25.559577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:25.559652 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:25.559608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:25.559652 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:25.559646 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559655 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559700 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559725 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls podName:0aa40a1c-f159-46ce-bb32-edfd76c2f4d7 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.559704624 +0000 UTC m=+51.177409424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls") pod "cluster-samples-operator-6748489656-dgp5v" (UID: "0aa40a1c-f159-46ce-bb32-edfd76c2f4d7") : secret "samples-operator-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559654 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559744 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559750 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74bb6776d4-5pm8p: secret "image-registry-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559766 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls podName:40adc67f-064a-4b8e-b633-426d01c27cb4 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.559748828 +0000 UTC m=+51.177453623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5bjp4" (UID: "40adc67f-064a-4b8e-b633-426d01c27cb4") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559770 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559801 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.55979064 +0000 UTC m=+51.177495420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : configmap references non-existent config key: service-ca.crt Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559846 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.559834944 +0000 UTC m=+51.177539730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : secret "router-metrics-certs-default" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559863 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls podName:3d1281ba-006c-4921-a314-33cfecf282f3 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.559854911 +0000 UTC m=+51.177559697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls") pod "dns-default-4t58r" (UID: "3d1281ba-006c-4921-a314-33cfecf282f3") : secret "dns-default-metrics-tls" not found Jul 27 16:51:25.559911 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:25.559876 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls podName:674234bf-6e5b-48fa-833f-be4cb0599e62 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.559871016 +0000 UTC m=+51.177575796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls") pod "image-registry-74bb6776d4-5pm8p" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62") : secret "image-registry-tls" not found Jul 27 16:51:26.468098 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:26.468058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:26.468474 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:26.468187 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:51:26.468474 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:26.468254 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert podName:3180b606-4ae9-47cf-95a2-5886a3013e08 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:28.468238779 +0000 UTC m=+46.085943558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gpqhk" (UID: "3180b606-4ae9-47cf-95a2-5886a3013e08") : secret "networking-console-plugin-cert" not found Jul 27 16:51:28.294534 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.294488 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" event={"ID":"f71bdb77-5c80-44eb-be60-d16602467705","Type":"ContainerStarted","Data":"09148559a7141d1e13754171858c109e88e64bf6cbc24060377ece6842ca04d0"} Jul 27 16:51:28.296381 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.296350 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" event={"ID":"156d3618-4e03-48d3-8457-c797d18b808d","Type":"ContainerStarted","Data":"17e503f5d807dd7d44826067dd249cf0c924fa5c189f7389662ad79acbb67f8a"} Jul 27 16:51:28.297909 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.297884 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l2t2p" event={"ID":"002fff69-43cb-4b5f-974a-62723949be11","Type":"ContainerStarted","Data":"71b518e7d05eed9ad142c8d7f5c18e43556ba1f00b15024c503829d952a3b142"} Jul 27 16:51:28.299400 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.299377 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" event={"ID":"5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec","Type":"ContainerStarted","Data":"32b27717420d8fbd19f72c8adc3ef36571ca357ed12eb8a1c93202f2871a7159"} Jul 27 16:51:28.302464 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.302441 2582 generic.go:356] "Generic (PLEG): container finished" podID="60c6ae70-8209-4710-89ab-b4844f954466" containerID="42d18e0b4a097b06f6c742de0a1e140327afa2b0b7a3c1a6c04f7f905e156b56" exitCode=0 Jul 27 16:51:28.302568 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.302504 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerDied","Data":"42d18e0b4a097b06f6c742de0a1e140327afa2b0b7a3c1a6c04f7f905e156b56"} Jul 27 16:51:28.305043 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.304998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" event={"ID":"553dba1f-63e4-47d0-92b3-a7e7736bfc54","Type":"ContainerStarted","Data":"19255f3a86cfabd29b6187b0e01c1d1f08470508f999fbc0da8a1c8b35869c79"} Jul 27 16:51:28.306642 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.306625 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/0.log" Jul 27 16:51:28.306728 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.306669 2582 generic.go:356] "Generic (PLEG): container finished" podID="38702e26-d8ec-428d-ad54-5b4fc3a6b1f9" containerID="3434a244a700bb65cafa9e7b2431e3fcbdce605614ca2b1c50b3f8a8e741aced" exitCode=255 Jul 27 16:51:28.306835 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.306799 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" event={"ID":"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9","Type":"ContainerDied","Data":"3434a244a700bb65cafa9e7b2431e3fcbdce605614ca2b1c50b3f8a8e741aced"} Jul 27 16:51:28.306959 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.306944 2582 scope.go:117] "RemoveContainer" containerID="3434a244a700bb65cafa9e7b2431e3fcbdce605614ca2b1c50b3f8a8e741aced" Jul 27 16:51:28.309662 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.309623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hsfsj" event={"ID":"0b45b08f-5c6e-4445-8745-646eb7af6e34","Type":"ContainerStarted","Data":"5aeab5565f4f6ec2d73f2ebe0b50f9d1794f7225fe1691687b493ed85d231d69"} Jul 27 16:51:28.313888 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.313842 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" podStartSLOduration=29.288622005 podStartE2EDuration="38.313805219s" totalImagesPullingTime="9.025183214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:28.312154628 +0000 UTC m=+45.929859432" watchObservedRunningTime="2026-07-27 16:51:28.313805219 +0000 UTC m=+45.931510022" Jul 27 16:51:28.399766 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.396774 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-pk2x7" podStartSLOduration=24.409561427 podStartE2EDuration="33.396754249s" totalImagesPullingTime="8.987192822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:28.341255059 +0000 UTC m=+45.958959862" watchObservedRunningTime="2026-07-27 16:51:28.396754249 +0000 UTC m=+46.014459052" Jul 27 16:51:28.413856 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.413788 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l2t2p" podStartSLOduration=2.3880670139999998 podStartE2EDuration="11.413773782s" totalImagesPullingTime="9.025706768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:28.413034456 +0000 UTC m=+46.030739276" watchObservedRunningTime="2026-07-27 16:51:28.413773782 +0000 UTC m=+46.031478583" Jul 27 16:51:28.458773 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.458730 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-cp4jl" podStartSLOduration=29.437051287 podStartE2EDuration="38.458712524s" totalImagesPullingTime="9.021661237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:28.457194588 +0000 UTC m=+46.074899390" watchObservedRunningTime="2026-07-27 16:51:28.458712524 +0000 UTC m=+46.076417326" Jul 27 16:51:28.482129 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.481795 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" podStartSLOduration=29.467839706 podStartE2EDuration="38.481774962s" totalImagesPullingTime="9.013935256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:28.480056507 +0000 UTC m=+46.097761321" watchObservedRunningTime="2026-07-27 16:51:28.481774962 +0000 UTC m=+46.099479766" Jul 27 16:51:28.490330 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.490118 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:28.490330 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:28.490272 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:51:28.490330 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:28.490325 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert podName:3180b606-4ae9-47cf-95a2-5886a3013e08 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:32.490308151 +0000 UTC m=+50.108012934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gpqhk" (UID: "3180b606-4ae9-47cf-95a2-5886a3013e08") : secret "networking-console-plugin-cert" not found Jul 27 16:51:28.507937 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:28.507883 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-hsfsj" podStartSLOduration=29.40505972 podStartE2EDuration="38.507861728s" totalImagesPullingTime="9.102802008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:28.50688475 +0000 UTC m=+46.124589579" watchObservedRunningTime="2026-07-27 16:51:28.507861728 +0000 UTC m=+46.125566529" Jul 27 16:51:29.316492 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.316458 2582 generic.go:356] "Generic (PLEG): container finished" podID="60c6ae70-8209-4710-89ab-b4844f954466" containerID="44583788fb1db21cbc60454fd31b234fa39800adabd776671c33ca8c3064589c" exitCode=0 Jul 27 16:51:29.316980 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.316537 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerDied","Data":"44583788fb1db21cbc60454fd31b234fa39800adabd776671c33ca8c3064589c"} Jul 27 16:51:29.318160 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.318140 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 16:51:29.318515 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.318501 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/0.log" Jul 27 16:51:29.318586 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.318532 2582 generic.go:356] "Generic (PLEG): container finished" podID="38702e26-d8ec-428d-ad54-5b4fc3a6b1f9" containerID="ea2e48e66c765a09af22bc640f6b79d09e9470da19079dc6068db7bef2e82f6d" exitCode=255 Jul 27 16:51:29.318586 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.318561 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" event={"ID":"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9","Type":"ContainerDied","Data":"ea2e48e66c765a09af22bc640f6b79d09e9470da19079dc6068db7bef2e82f6d"} Jul 27 16:51:29.329266 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.329243 2582 scope.go:117] "RemoveContainer" containerID="3434a244a700bb65cafa9e7b2431e3fcbdce605614ca2b1c50b3f8a8e741aced" Jul 27 16:51:29.329361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.329347 2582 scope.go:117] "RemoveContainer" containerID="ea2e48e66c765a09af22bc640f6b79d09e9470da19079dc6068db7bef2e82f6d" Jul 27 16:51:29.329546 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:29.329527 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-64gq6_openshift-console-operator(38702e26-d8ec-428d-ad54-5b4fc3a6b1f9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" podUID="38702e26-d8ec-428d-ad54-5b4fc3a6b1f9" Jul 27 16:51:29.495418 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.495389 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gwc6f"] Jul 27 16:51:29.514447 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.514416 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.514748 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.514727 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gwc6f"] Jul 27 16:51:29.517278 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.517252 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 16:51:29.517397 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.517344 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 16:51:29.517397 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.517373 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzjcc\"" Jul 27 16:51:29.594126 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.594050 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr"] Jul 27 16:51:29.600837 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.600801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.600978 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.600856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c2284e8-1470-4602-9798-0c94bd335960-data-volume\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.600978 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.600941 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbh8\" (UniqueName: \"kubernetes.io/projected/6c2284e8-1470-4602-9798-0c94bd335960-kube-api-access-ldbh8\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.601096 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.601049 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.601163 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.601145 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c2284e8-1470-4602-9798-0c94bd335960-crio-socket\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.618216 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.618191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" Jul 27 16:51:29.619938 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.619911 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr"] Jul 27 16:51:29.623620 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.623589 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 16:51:29.623730 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.623634 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 16:51:29.623912 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.623881 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lmp66\"" Jul 27 16:51:29.702039 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbh8\" (UniqueName: \"kubernetes.io/projected/6c2284e8-1470-4602-9798-0c94bd335960-kube-api-access-ldbh8\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.702218 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.702218 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702132 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c2284e8-1470-4602-9798-0c94bd335960-crio-socket\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.702218 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.702218 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702178 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42rmp\" (UniqueName: \"kubernetes.io/projected/e9b70a84-813c-47b8-947d-1608b13ee1bb-kube-api-access-42rmp\") pod \"migrator-6865c9967-lr6gr\" (UID: \"e9b70a84-813c-47b8-947d-1608b13ee1bb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" Jul 27 16:51:29.702218 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:29.702210 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:51:29.702426 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c2284e8-1470-4602-9798-0c94bd335960-data-volume\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.702426 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:29.702290 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:51:29.702426 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:29.702276 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:30.202255593 +0000 UTC m=+47.819960373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : configmap "kube-rbac-proxy" not found Jul 27 16:51:29.702426 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702354 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c2284e8-1470-4602-9798-0c94bd335960-crio-socket\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.702426 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:29.702373 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:30.202356824 +0000 UTC m=+47.820061613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : secret "insights-runtime-extractor-tls" not found Jul 27 16:51:29.702590 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.702528 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c2284e8-1470-4602-9798-0c94bd335960-data-volume\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.714407 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.714379 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbh8\" (UniqueName: \"kubernetes.io/projected/6c2284e8-1470-4602-9798-0c94bd335960-kube-api-access-ldbh8\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:29.802832 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.802785 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42rmp\" (UniqueName: \"kubernetes.io/projected/e9b70a84-813c-47b8-947d-1608b13ee1bb-kube-api-access-42rmp\") pod \"migrator-6865c9967-lr6gr\" (UID: \"e9b70a84-813c-47b8-947d-1608b13ee1bb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" Jul 27 16:51:29.812141 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.812110 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42rmp\" (UniqueName: \"kubernetes.io/projected/e9b70a84-813c-47b8-947d-1608b13ee1bb-kube-api-access-42rmp\") pod \"migrator-6865c9967-lr6gr\" (UID: \"e9b70a84-813c-47b8-947d-1608b13ee1bb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" Jul 27 16:51:29.930267 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:29.930185 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" Jul 27 16:51:30.069775 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.069745 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr"] Jul 27 16:51:30.072607 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:30.072579 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b70a84_813c_47b8_947d_1608b13ee1bb.slice/crio-902be62b0233fb82bbb1524508d59646d0683481cc692ed98f927cba218b951e WatchSource:0}: Error finding container 902be62b0233fb82bbb1524508d59646d0683481cc692ed98f927cba218b951e: Status 404 returned error can't find the container with id 902be62b0233fb82bbb1524508d59646d0683481cc692ed98f927cba218b951e Jul 27 16:51:30.207596 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.207497 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:30.207747 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:30.207652 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:51:30.207747 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.207718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:30.207747 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:30.207728 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:31.20771171 +0000 UTC m=+48.825416489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : secret "insights-runtime-extractor-tls" not found Jul 27 16:51:30.207885 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:30.207768 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:51:30.207885 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:30.207813 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:31.207801899 +0000 UTC m=+48.825506679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : configmap "kube-rbac-proxy" not found Jul 27 16:51:30.322978 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.322939 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" event={"ID":"e9b70a84-813c-47b8-947d-1608b13ee1bb","Type":"ContainerStarted","Data":"902be62b0233fb82bbb1524508d59646d0683481cc692ed98f927cba218b951e"} Jul 27 16:51:30.326510 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.326483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" event={"ID":"60c6ae70-8209-4710-89ab-b4844f954466","Type":"ContainerStarted","Data":"4fd65e9410389822f0c3ff37e3276b5c76080be75fdeee01136c781f03d05019"} Jul 27 16:51:30.327938 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.327919 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 16:51:30.328181 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.328168 2582 scope.go:117] "RemoveContainer" containerID="ea2e48e66c765a09af22bc640f6b79d09e9470da19079dc6068db7bef2e82f6d" Jul 27 16:51:30.328317 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:30.328299 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-64gq6_openshift-console-operator(38702e26-d8ec-428d-ad54-5b4fc3a6b1f9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" podUID="38702e26-d8ec-428d-ad54-5b4fc3a6b1f9" Jul 27 16:51:30.349982 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.349852 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzzzp" podStartSLOduration=8.856714062 podStartE2EDuration="46.349833501s" totalImagesPullingTime="37.493119439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:30.348802643 +0000 UTC m=+47.966507471" watchObservedRunningTime="2026-07-27 16:51:30.349833501 +0000 UTC m=+47.967538303" Jul 27 16:51:30.875350 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:30.875323 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whfns_2f97815a-35d9-470a-a9c9-1ee7af844642/dns-node-resolver/0.log" Jul 27 16:51:31.218974 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:31.218892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:31.219136 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:31.218995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:31.219136 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:31.219020 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:51:31.219136 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:31.219086 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.219067383 +0000 UTC m=+50.836772174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : configmap "kube-rbac-proxy" not found Jul 27 16:51:31.219297 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:31.219170 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:51:31.219297 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:31.219237 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:33.21921701 +0000 UTC m=+50.836921816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : secret "insights-runtime-extractor-tls" not found Jul 27 16:51:31.677000 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:31.676967 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hhqxq_4aa87403-1a29-4193-9948-c9805d93f3a8/node-ca/0.log" Jul 27 16:51:32.277799 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:32.277721 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l2t2p_002fff69-43cb-4b5f-974a-62723949be11/serve-healthcheck-canary/0.log" Jul 27 16:51:32.337118 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:32.337082 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" event={"ID":"e9b70a84-813c-47b8-947d-1608b13ee1bb","Type":"ContainerStarted","Data":"897d8d355c5d9d10c44eff8fbfe87b984aa7e8be432bf079f1c9837a92725aa9"} Jul 27 16:51:32.337298 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:32.337132 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" event={"ID":"e9b70a84-813c-47b8-947d-1608b13ee1bb","Type":"ContainerStarted","Data":"acb615fcafe4b49570b36e7c4bc54714a3efc281d63ccccec5d4953ed873e402"} Jul 27 16:51:32.531359 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:32.531262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:32.531521 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:32.531405 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:51:32.531521 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:32.531477 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert podName:3180b606-4ae9-47cf-95a2-5886a3013e08 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:40.531460827 +0000 UTC m=+58.149165608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gpqhk" (UID: "3180b606-4ae9-47cf-95a2-5886a3013e08") : secret "networking-console-plugin-cert" not found Jul 27 16:51:33.236073 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.236025 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:33.236559 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.236159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:33.236559 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.236178 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:51:33.236559 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.236243 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:37.236228846 +0000 UTC m=+54.853933627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : secret "insights-runtime-extractor-tls" not found Jul 27 16:51:33.236559 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.236252 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:51:33.236559 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.236305 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:37.236294089 +0000 UTC m=+54.853998869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : configmap "kube-rbac-proxy" not found Jul 27 16:51:33.639026 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.638986 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:33.639026 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.639031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.639059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.639145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639152 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639189 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:49.639170987 +0000 UTC m=+67.256875767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : configmap references non-existent config key: service-ca.crt Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639219 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs podName:8a729f11-ce8d-4a21-ac4b-907484ec1d69 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:49.639209458 +0000 UTC m=+67.256914244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs") pod "router-default-646b69665-d6chx" (UID: "8a729f11-ce8d-4a21-ac4b-907484ec1d69") : secret "router-metrics-certs-default" not found Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.639234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639237 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639245 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639258 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74bb6776d4-5pm8p: secret "image-registry-tls" not found Jul 27 16:51:33.639263 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:33.639261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:33.639642 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639284 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls podName:3d1281ba-006c-4921-a314-33cfecf282f3 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:49.639273409 +0000 UTC m=+67.256978211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls") pod "dns-default-4t58r" (UID: "3d1281ba-006c-4921-a314-33cfecf282f3") : secret "dns-default-metrics-tls" not found Jul 27 16:51:33.639642 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639306 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls podName:674234bf-6e5b-48fa-833f-be4cb0599e62 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:49.639297208 +0000 UTC m=+67.257001994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls") pod "image-registry-74bb6776d4-5pm8p" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62") : secret "image-registry-tls" not found Jul 27 16:51:33.639642 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639324 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:33.639642 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639357 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls podName:40adc67f-064a-4b8e-b633-426d01c27cb4 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:49.639349181 +0000 UTC m=+67.257053966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-5bjp4" (UID: "40adc67f-064a-4b8e-b633-426d01c27cb4") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:51:33.639642 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639326 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 16:51:33.639642 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:33.639383 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls podName:0aa40a1c-f159-46ce-bb32-edfd76c2f4d7 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:49.639377889 +0000 UTC m=+67.257082668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls") pod "cluster-samples-operator-6748489656-dgp5v" (UID: "0aa40a1c-f159-46ce-bb32-edfd76c2f4d7") : secret "samples-operator-tls" not found Jul 27 16:51:37.275376 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:37.275340 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:37.275922 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:37.275413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:37.275922 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:37.275545 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:51:37.275922 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:37.275605 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls podName:6c2284e8-1470-4602-9798-0c94bd335960 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:45.275588618 +0000 UTC m=+62.893293404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwc6f" (UID: "6c2284e8-1470-4602-9798-0c94bd335960") : secret "insights-runtime-extractor-tls" not found Jul 27 16:51:37.275922 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:37.275871 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c2284e8-1470-4602-9798-0c94bd335960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:38.072445 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:38.072399 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:38.072624 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:38.072466 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:38.072861 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:38.072848 2582 scope.go:117] "RemoveContainer" containerID="ea2e48e66c765a09af22bc640f6b79d09e9470da19079dc6068db7bef2e82f6d" Jul 27 16:51:38.073036 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:38.073017 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-64gq6_openshift-console-operator(38702e26-d8ec-428d-ad54-5b4fc3a6b1f9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" podUID="38702e26-d8ec-428d-ad54-5b4fc3a6b1f9" Jul 27 16:51:40.605369 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:40.605330 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:40.605868 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:40.605525 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:51:40.605868 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:51:40.605608 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert podName:3180b606-4ae9-47cf-95a2-5886a3013e08 nodeName:}" failed. No retries permitted until 2026-07-27 16:51:56.605586928 +0000 UTC m=+74.223291721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gpqhk" (UID: "3180b606-4ae9-47cf-95a2-5886a3013e08") : secret "networking-console-plugin-cert" not found Jul 27 16:51:44.238290 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:44.238262 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svr4j" Jul 27 16:51:44.287376 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:44.287314 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-lr6gr" podStartSLOduration=13.563690954 podStartE2EDuration="15.287274847s" totalImagesPullingTime="1.723583893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:32.37272067 +0000 UTC m=+49.990425471" watchObservedRunningTime="2026-07-27 16:51:44.287274847 +0000 UTC m=+61.904979686" Jul 27 16:51:45.344495 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:45.344453 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:45.346880 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:45.346854 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c2284e8-1470-4602-9798-0c94bd335960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwc6f\" (UID: \"6c2284e8-1470-4602-9798-0c94bd335960\") " pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:45.426684 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:45.426651 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzjcc\"" Jul 27 16:51:45.434672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:45.434652 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gwc6f" Jul 27 16:51:45.564954 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:45.564924 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gwc6f"] Jul 27 16:51:45.568101 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:45.568075 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2284e8_1470_4602_9798_0c94bd335960.slice/crio-5790f39118d842e52690d34a27b5fca131a0dd7e6204d4e37cfa19a080215892 WatchSource:0}: Error finding container 5790f39118d842e52690d34a27b5fca131a0dd7e6204d4e37cfa19a080215892: Status 404 returned error can't find the container with id 5790f39118d842e52690d34a27b5fca131a0dd7e6204d4e37cfa19a080215892 Jul 27 16:51:46.382839 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:46.382781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwc6f" event={"ID":"6c2284e8-1470-4602-9798-0c94bd335960","Type":"ContainerStarted","Data":"5790f39118d842e52690d34a27b5fca131a0dd7e6204d4e37cfa19a080215892"} Jul 27 16:51:48.574290 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.574253 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:48.574290 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.574293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:48.577420 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.577395 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 16:51:48.577869 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.577851 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 16:51:48.586897 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.586879 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7aad7c5c-40cb-4533-8095-01c95334bf4f-original-pull-secret\") pod \"global-pull-secret-syncer-lz5dv\" (UID: \"7aad7c5c-40cb-4533-8095-01c95334bf4f\") " pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:48.587013 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.586969 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c0a30c1-ed92-447a-a426-427bdffa913b-metrics-certs\") pod \"network-metrics-daemon-sjrqj\" (UID: \"8c0a30c1-ed92-447a-a426-427bdffa913b\") " pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:48.646124 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.646092 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86zvt\"" Jul 27 16:51:48.650179 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.650153 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lz5dv" Jul 27 16:51:48.654417 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.654359 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sjrqj" Jul 27 16:51:48.776284 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.776248 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:48.779176 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.779148 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmkm6\" (UniqueName: \"kubernetes.io/projected/9d97b403-3995-4419-8c1e-be90f78de9b0-kube-api-access-wmkm6\") pod \"network-check-target-spsdn\" (UID: \"9d97b403-3995-4419-8c1e-be90f78de9b0\") " pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:48.939541 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.939453 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5hns5\"" Jul 27 16:51:48.948133 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:48.948103 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:49.684357 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.684316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:49.684915 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.684405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:49.684915 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.684446 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:49.684915 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.684471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:49.684915 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.684505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:49.684915 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.684538 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:49.685306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.685278 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a729f11-ce8d-4a21-ac4b-907484ec1d69-service-ca-bundle\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:49.687118 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.687088 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a729f11-ce8d-4a21-ac4b-907484ec1d69-metrics-certs\") pod \"router-default-646b69665-d6chx\" (UID: \"8a729f11-ce8d-4a21-ac4b-907484ec1d69\") " pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:49.687252 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.687176 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/40adc67f-064a-4b8e-b633-426d01c27cb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-5bjp4\" (UID: \"40adc67f-064a-4b8e-b633-426d01c27cb4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:49.687309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.687244 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d1281ba-006c-4921-a314-33cfecf282f3-metrics-tls\") pod \"dns-default-4t58r\" (UID: \"3d1281ba-006c-4921-a314-33cfecf282f3\") " pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:49.687416 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.687393 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0aa40a1c-f159-46ce-bb32-edfd76c2f4d7-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-dgp5v\" (UID: \"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:49.687460 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.687440 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"image-registry-74bb6776d4-5pm8p\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:49.828426 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.828396 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rpnv7\"" Jul 27 16:51:49.836333 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.836302 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" Jul 27 16:51:49.854956 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.854927 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6kbc\"" Jul 27 16:51:49.863633 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.863613 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:49.868086 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.868063 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8b896\"" Jul 27 16:51:49.876782 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.876760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" Jul 27 16:51:49.901503 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.901476 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s4r7m\"" Jul 27 16:51:49.909466 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.909440 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:49.915291 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.915270 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tkpjp\"" Jul 27 16:51:49.924008 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:49.923980 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:50.024564 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.024483 2582 scope.go:117] "RemoveContainer" containerID="ea2e48e66c765a09af22bc640f6b79d09e9470da19079dc6068db7bef2e82f6d" Jul 27 16:51:50.526404 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.526374 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-spsdn"] Jul 27 16:51:50.589332 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.589064 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74bb6776d4-5pm8p"] Jul 27 16:51:50.611732 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:50.611374 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674234bf_6e5b_48fa_833f_be4cb0599e62.slice/crio-a812486e4967c2fb7974a9081a408c33a98c5b248a23bf9fab01f4bb5d3ac43e WatchSource:0}: Error finding container a812486e4967c2fb7974a9081a408c33a98c5b248a23bf9fab01f4bb5d3ac43e: Status 404 returned error can't find the container with id a812486e4967c2fb7974a9081a408c33a98c5b248a23bf9fab01f4bb5d3ac43e Jul 27 16:51:50.666619 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.666542 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4t58r"] Jul 27 16:51:50.688463 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.687960 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lz5dv"] Jul 27 16:51:50.697846 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:50.697690 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aad7c5c_40cb_4533_8095_01c95334bf4f.slice/crio-86035a8bc31c330ab643f3dd72da38adb1d80c7cfb46e3b2874eba65df33abab WatchSource:0}: Error finding container 86035a8bc31c330ab643f3dd72da38adb1d80c7cfb46e3b2874eba65df33abab: Status 404 returned error can't find the container with id 86035a8bc31c330ab643f3dd72da38adb1d80c7cfb46e3b2874eba65df33abab Jul 27 16:51:50.705152 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.705074 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4"] Jul 27 16:51:50.706021 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.705968 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sjrqj"] Jul 27 16:51:50.707567 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:50.707536 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40adc67f_064a_4b8e_b633_426d01c27cb4.slice/crio-f0772e651204dff90e5c25bc9024af257111528b8d704e4b7170f9e0983009af WatchSource:0}: Error finding container f0772e651204dff90e5c25bc9024af257111528b8d704e4b7170f9e0983009af: Status 404 returned error can't find the container with id f0772e651204dff90e5c25bc9024af257111528b8d704e4b7170f9e0983009af Jul 27 16:51:50.708564 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:50.708539 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0a30c1_ed92_447a_a426_427bdffa913b.slice/crio-94046d4d9e38056933db48fbf4a3d945a51e738425be307600a500dc2910ce68 WatchSource:0}: Error finding container 94046d4d9e38056933db48fbf4a3d945a51e738425be307600a500dc2910ce68: Status 404 returned error can't find the container with id 94046d4d9e38056933db48fbf4a3d945a51e738425be307600a500dc2910ce68 Jul 27 16:51:50.729703 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.729667 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v"] Jul 27 16:51:50.753774 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:50.753746 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-646b69665-d6chx"] Jul 27 16:51:50.756360 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:50.756337 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a729f11_ce8d_4a21_ac4b_907484ec1d69.slice/crio-9634bc4af4238955d715390fb04ca45455cdf7adf42be845ae6ec75fefe34a27 WatchSource:0}: Error finding container 9634bc4af4238955d715390fb04ca45455cdf7adf42be845ae6ec75fefe34a27: Status 404 returned error can't find the container with id 9634bc4af4238955d715390fb04ca45455cdf7adf42be845ae6ec75fefe34a27 Jul 27 16:51:51.416044 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.415952 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" event={"ID":"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7","Type":"ContainerStarted","Data":"20178863e90fda128978d1dd12936834be7a654858cca162b7fd52cf2f655eac"} Jul 27 16:51:51.418270 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.418194 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lz5dv" event={"ID":"7aad7c5c-40cb-4533-8095-01c95334bf4f","Type":"ContainerStarted","Data":"86035a8bc31c330ab643f3dd72da38adb1d80c7cfb46e3b2874eba65df33abab"} Jul 27 16:51:51.420989 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.420956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4t58r" event={"ID":"3d1281ba-006c-4921-a314-33cfecf282f3","Type":"ContainerStarted","Data":"08d06cc5e8184bf44b3589137910fcd3ed6ec66ee4c99cfe23ea10b8cbe77821"} Jul 27 16:51:51.423377 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.423224 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjrqj" event={"ID":"8c0a30c1-ed92-447a-a426-427bdffa913b","Type":"ContainerStarted","Data":"94046d4d9e38056933db48fbf4a3d945a51e738425be307600a500dc2910ce68"} Jul 27 16:51:51.426925 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.426901 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" event={"ID":"40adc67f-064a-4b8e-b633-426d01c27cb4","Type":"ContainerStarted","Data":"f0772e651204dff90e5c25bc9024af257111528b8d704e4b7170f9e0983009af"} Jul 27 16:51:51.430955 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.429990 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" event={"ID":"674234bf-6e5b-48fa-833f-be4cb0599e62","Type":"ContainerStarted","Data":"6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6"} Jul 27 16:51:51.430955 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.430042 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" event={"ID":"674234bf-6e5b-48fa-833f-be4cb0599e62","Type":"ContainerStarted","Data":"a812486e4967c2fb7974a9081a408c33a98c5b248a23bf9fab01f4bb5d3ac43e"} Jul 27 16:51:51.430955 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.430897 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:51:51.433141 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.433013 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwc6f" event={"ID":"6c2284e8-1470-4602-9798-0c94bd335960","Type":"ContainerStarted","Data":"5d0b7b975596ed9630ad930ea0f611afc04d3cc38f199ea48cb29f40fd6833cd"} Jul 27 16:51:51.439719 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.438999 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-646b69665-d6chx" event={"ID":"8a729f11-ce8d-4a21-ac4b-907484ec1d69","Type":"ContainerStarted","Data":"dac21167daeab2b86ef13a5143a38f559399cde4721272cc2e2bf72900e31441"} Jul 27 16:51:51.439719 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.439116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-646b69665-d6chx" event={"ID":"8a729f11-ce8d-4a21-ac4b-907484ec1d69","Type":"ContainerStarted","Data":"9634bc4af4238955d715390fb04ca45455cdf7adf42be845ae6ec75fefe34a27"} Jul 27 16:51:51.442465 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.442439 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-spsdn" event={"ID":"9d97b403-3995-4419-8c1e-be90f78de9b0","Type":"ContainerStarted","Data":"01109b977cdebb75fc464389df10d169090c86eac553b1b98ba3b8d607b5cd92"} Jul 27 16:51:51.442671 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.442486 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-spsdn" event={"ID":"9d97b403-3995-4419-8c1e-be90f78de9b0","Type":"ContainerStarted","Data":"e392b5bf68dbb37dda5b4f81ed22e9744f34966159e1c5dee4120fdc70e41aca"} Jul 27 16:51:51.442926 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.442886 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:51:51.447013 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.446141 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 16:51:51.447013 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.446206 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" event={"ID":"38702e26-d8ec-428d-ad54-5b4fc3a6b1f9","Type":"ContainerStarted","Data":"c2a19e20134807d1896fd00fb59ebd71284f8626329291f193bb3a5854c5ee94"} Jul 27 16:51:51.447013 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.446962 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:51.454753 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.454633 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" podStartSLOduration=67.4546148 podStartE2EDuration="1m7.4546148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:51.451907129 +0000 UTC m=+69.069611946" watchObservedRunningTime="2026-07-27 16:51:51.4546148 +0000 UTC m=+69.072319603" Jul 27 16:51:51.498830 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.498758 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-646b69665-d6chx" podStartSLOduration=61.498733179 podStartE2EDuration="1m1.498733179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:51.478523427 +0000 UTC m=+69.096228289" watchObservedRunningTime="2026-07-27 16:51:51.498733179 +0000 UTC m=+69.116437982" Jul 27 16:51:51.522114 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.522055 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-spsdn" podStartSLOduration=67.52203468 podStartE2EDuration="1m7.52203468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:51.499812592 +0000 UTC m=+69.117517394" watchObservedRunningTime="2026-07-27 16:51:51.52203468 +0000 UTC m=+69.139739483" Jul 27 16:51:51.523351 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.523210 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" podStartSLOduration=52.500857868 podStartE2EDuration="1m1.523193757s" totalImagesPullingTime="9.022335889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:51.521227638 +0000 UTC m=+69.138932477" watchObservedRunningTime="2026-07-27 16:51:51.523193757 +0000 UTC m=+69.140898560" Jul 27 16:51:51.913202 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.913124 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:51.916288 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:51.916264 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:52.456361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:52.456033 2582 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-64gq6 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 27 16:51:52.456361 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:52.456099 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" podUID="38702e26-d8ec-428d-ad54-5b4fc3a6b1f9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 27 16:51:52.465925 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:52.465293 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:52.467005 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:52.466985 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-646b69665-d6chx" Jul 27 16:51:52.620069 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:52.619681 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-64gq6" Jul 27 16:51:53.469565 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:53.469525 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjrqj" event={"ID":"8c0a30c1-ed92-447a-a426-427bdffa913b","Type":"ContainerStarted","Data":"581660d45849924d4977bb8fc8010dd6385efbde3fa897ef322842b3e5379a4b"} Jul 27 16:51:53.470040 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:53.469590 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sjrqj" event={"ID":"8c0a30c1-ed92-447a-a426-427bdffa913b","Type":"ContainerStarted","Data":"b11e9a6058da2075cf520bf52b7ec4171699d7f958b776f0beb845f33faa4b14"} Jul 27 16:51:53.490047 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:53.489996 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sjrqj" podStartSLOduration=67.837629001 podStartE2EDuration="1m9.489979388s" totalImagesPullingTime="1.652350387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:53.487812278 +0000 UTC m=+71.105517108" watchObservedRunningTime="2026-07-27 16:51:53.489979388 +0000 UTC m=+71.107684191" Jul 27 16:51:56.664875 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:56.664812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:56.667493 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:56.667465 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3180b606-4ae9-47cf-95a2-5886a3013e08-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gpqhk\" (UID: \"3180b606-4ae9-47cf-95a2-5886a3013e08\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:56.821611 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:56.821578 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-smp2w\"" Jul 27 16:51:56.829571 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:56.829550 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" Jul 27 16:51:58.812473 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:58.812408 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk"] Jul 27 16:51:58.817272 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:51:58.817243 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3180b606_4ae9_47cf_95a2_5886a3013e08.slice/crio-aec0c20b5741a60cc522d33c637e4928b44bda526edf61b1ada24f0c392ad2cf WatchSource:0}: Error finding container aec0c20b5741a60cc522d33c637e4928b44bda526edf61b1ada24f0c392ad2cf: Status 404 returned error can't find the container with id aec0c20b5741a60cc522d33c637e4928b44bda526edf61b1ada24f0c392ad2cf Jul 27 16:51:59.493958 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.493917 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" event={"ID":"3180b606-4ae9-47cf-95a2-5886a3013e08","Type":"ContainerStarted","Data":"aec0c20b5741a60cc522d33c637e4928b44bda526edf61b1ada24f0c392ad2cf"} Jul 27 16:51:59.495591 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.495553 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4t58r" event={"ID":"3d1281ba-006c-4921-a314-33cfecf282f3","Type":"ContainerStarted","Data":"f1a51c7aedf0af58e03bd898cb7fa153a132135abdf29de73ba6ca8bb4a5c6b8"} Jul 27 16:51:59.495736 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.495601 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4t58r" event={"ID":"3d1281ba-006c-4921-a314-33cfecf282f3","Type":"ContainerStarted","Data":"954f154deacda054f8ad6d6b02036a8e9cc43cf3e9426e7de0cb12e73da27748"} Jul 27 16:51:59.495736 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.495646 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4t58r" Jul 27 16:51:59.497150 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.497123 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" event={"ID":"40adc67f-064a-4b8e-b633-426d01c27cb4","Type":"ContainerStarted","Data":"e38db4a1e57ff27e732fc58658fc4b59ce293972364635d399d6412e22c283b4"} Jul 27 16:51:59.498664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.498642 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" event={"ID":"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7","Type":"ContainerStarted","Data":"74cf024e3c87c58fd6cdcb59440e81867377be623bdcca7b897e4f7e78ad983f"} Jul 27 16:51:59.498780 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.498695 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" event={"ID":"0aa40a1c-f159-46ce-bb32-edfd76c2f4d7","Type":"ContainerStarted","Data":"5db6088a7ce277a33b18cb9bbb4b716f8fa9649d43be90b1b066c01be9421f4b"} Jul 27 16:51:59.500424 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.500401 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwc6f" event={"ID":"6c2284e8-1470-4602-9798-0c94bd335960","Type":"ContainerStarted","Data":"b4e8db7c4a399beca14add57a1a778f626f9c51d1424b3872fe243ce252219fe"} Jul 27 16:51:59.501738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.501717 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lz5dv" event={"ID":"7aad7c5c-40cb-4533-8095-01c95334bf4f","Type":"ContainerStarted","Data":"4fcea98ccab4be9e11196061d20912a219adf01ce4dd02b8718f5f4c39a35cab"} Jul 27 16:51:59.519542 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.519492 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4t58r" podStartSLOduration=34.677804654 podStartE2EDuration="42.519480522s" totalImagesPullingTime="7.841675868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:59.518164153 +0000 UTC m=+77.135868978" watchObservedRunningTime="2026-07-27 16:51:59.519480522 +0000 UTC m=+77.137185323" Jul 27 16:51:59.538356 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.538313 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-5bjp4" podStartSLOduration=61.716262558 podStartE2EDuration="1m9.538276649s" totalImagesPullingTime="7.822014091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:59.537840045 +0000 UTC m=+77.155544871" watchObservedRunningTime="2026-07-27 16:51:59.538276649 +0000 UTC m=+77.155981451" Jul 27 16:51:59.557143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.557084 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lz5dv" podStartSLOduration=67.59327902 podStartE2EDuration="1m15.557066783s" totalImagesPullingTime="7.963787763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:59.556741457 +0000 UTC m=+77.174446260" watchObservedRunningTime="2026-07-27 16:51:59.557066783 +0000 UTC m=+77.174771586" Jul 27 16:51:59.582566 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:51:59.582518 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-dgp5v" podStartSLOduration=61.709200974 podStartE2EDuration="1m9.582502351s" totalImagesPullingTime="7.873301377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:51:59.582258392 +0000 UTC m=+77.199963196" watchObservedRunningTime="2026-07-27 16:51:59.582502351 +0000 UTC m=+77.200207152" Jul 27 16:52:01.512317 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:01.512272 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" event={"ID":"3180b606-4ae9-47cf-95a2-5886a3013e08","Type":"ContainerStarted","Data":"3c8367ca983eadc76c3b6e672ee31fd792cb86052f3fe272784e210244dfaa4f"} Jul 27 16:52:01.534273 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:01.534206 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gpqhk" podStartSLOduration=35.583473546 podStartE2EDuration="37.534189448s" totalImagesPullingTime="1.950715902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:52:01.533407151 +0000 UTC m=+79.151111954" watchObservedRunningTime="2026-07-27 16:52:01.534189448 +0000 UTC m=+79.151894250" Jul 27 16:52:04.526678 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:04.526640 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwc6f" event={"ID":"6c2284e8-1470-4602-9798-0c94bd335960","Type":"ContainerStarted","Data":"3b216fe33c399562eb34d6e0ff1ff14c262540f89e608fd0fe8630ddecb6278d"} Jul 27 16:52:04.545691 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:04.545640 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gwc6f" podStartSLOduration=17.999995976 podStartE2EDuration="35.545626126s" totalImagesPullingTime="17.54563015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:51:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:52:04.544093133 +0000 UTC m=+82.161797962" watchObservedRunningTime="2026-07-27 16:52:04.545626126 +0000 UTC m=+82.163330961" Jul 27 16:52:09.509435 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:09.509316 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4t58r" Jul 27 16:52:13.202505 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:13.199224 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74bb6776d4-5pm8p"] Jul 27 16:52:13.207042 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:13.207012 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:52:20.694205 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.694170 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r69c5"] Jul 27 16:52:20.744199 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.744154 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s"] Jul 27 16:52:20.744375 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.744287 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.746752 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.746725 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 16:52:20.746904 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.746774 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97849\"" Jul 27 16:52:20.746904 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.746797 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 16:52:20.746904 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.746867 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 16:52:20.747157 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.747142 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 16:52:20.762468 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.762447 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s"] Jul 27 16:52:20.762568 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.762546 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.764861 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.764838 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 27 16:52:20.764972 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.764845 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 27 16:52:20.765060 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.764992 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-phkz4\"" Jul 27 16:52:20.843643 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-wtmp\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.843643 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843642 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-sys\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.843874 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-accelerators-collector-config\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.843874 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467s7\" (UniqueName: \"kubernetes.io/projected/642bd38e-7d71-4811-8913-15422048f8cb-kube-api-access-467s7\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.843874 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-textfile\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.843874 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.843874 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.843874 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843864 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.844104 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.844104 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843939 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46bb9d73-33bd-40ac-8694-302299aa2a26-metrics-client-ca\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.844104 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/642bd38e-7d71-4811-8913-15422048f8cb-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.844104 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.843993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-root\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.844104 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.844032 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jvx\" (UniqueName: \"kubernetes.io/projected/46bb9d73-33bd-40ac-8694-302299aa2a26-kube-api-access-h4jvx\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.944843 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.944736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/642bd38e-7d71-4811-8913-15422048f8cb-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.944843 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.944787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-root\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.944843 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.944806 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jvx\" (UniqueName: \"kubernetes.io/projected/46bb9d73-33bd-40ac-8694-302299aa2a26-kube-api-access-h4jvx\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.944892 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-root\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.944954 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-wtmp\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.944992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-sys\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-accelerators-collector-config\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467s7\" (UniqueName: \"kubernetes.io/projected/642bd38e-7d71-4811-8913-15422048f8cb-kube-api-access-467s7\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945066 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-sys\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-textfile\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945132 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-wtmp\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:52:20.945322 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945333 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46bb9d73-33bd-40ac-8694-302299aa2a26-metrics-client-ca\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:52:20.945388 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls podName:46bb9d73-33bd-40ac-8694-302299aa2a26 nodeName:}" failed. No retries permitted until 2026-07-27 16:52:21.445369444 +0000 UTC m=+99.063074225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls") pod "node-exporter-r69c5" (UID: "46bb9d73-33bd-40ac-8694-302299aa2a26") : secret "node-exporter-tls" not found Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945459 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-textfile\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:52:20.945550 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945551 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/642bd38e-7d71-4811-8913-15422048f8cb-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.945664 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:52:20.945601 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-tls podName:642bd38e-7d71-4811-8913-15422048f8cb nodeName:}" failed. No retries permitted until 2026-07-27 16:52:21.445588209 +0000 UTC m=+99.063293004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-gv98s" (UID: "642bd38e-7d71-4811-8913-15422048f8cb") : secret "openshift-state-metrics-tls" not found Jul 27 16:52:20.946024 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945678 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-accelerators-collector-config\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.946024 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.945773 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46bb9d73-33bd-40ac-8694-302299aa2a26-metrics-client-ca\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.947440 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.947417 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.947591 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.947573 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:20.953670 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.953644 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jvx\" (UniqueName: \"kubernetes.io/projected/46bb9d73-33bd-40ac-8694-302299aa2a26-kube-api-access-h4jvx\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:20.953796 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:20.953745 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-467s7\" (UniqueName: \"kubernetes.io/projected/642bd38e-7d71-4811-8913-15422048f8cb-kube-api-access-467s7\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:21.449135 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:21.449096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:21.449302 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:21.449147 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:21.449302 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:52:21.449256 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 16:52:21.449391 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:52:21.449324 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls podName:46bb9d73-33bd-40ac-8694-302299aa2a26 nodeName:}" failed. No retries permitted until 2026-07-27 16:52:22.449308487 +0000 UTC m=+100.067013272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls") pod "node-exporter-r69c5" (UID: "46bb9d73-33bd-40ac-8694-302299aa2a26") : secret "node-exporter-tls" not found Jul 27 16:52:21.451595 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:21.451572 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/642bd38e-7d71-4811-8913-15422048f8cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gv98s\" (UID: \"642bd38e-7d71-4811-8913-15422048f8cb\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:21.671297 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:21.671254 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" Jul 27 16:52:21.906179 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:21.906146 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s"] Jul 27 16:52:21.909568 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:52:21.909536 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642bd38e_7d71_4811_8913_15422048f8cb.slice/crio-c16b23f2913cb709cb2ff7b4271b6a77656b5dc10a57ce614267249d34ad2552 WatchSource:0}: Error finding container c16b23f2913cb709cb2ff7b4271b6a77656b5dc10a57ce614267249d34ad2552: Status 404 returned error can't find the container with id c16b23f2913cb709cb2ff7b4271b6a77656b5dc10a57ce614267249d34ad2552 Jul 27 16:52:22.456191 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.456146 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:22.458427 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.458406 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46bb9d73-33bd-40ac-8694-302299aa2a26-node-exporter-tls\") pod \"node-exporter-r69c5\" (UID: \"46bb9d73-33bd-40ac-8694-302299aa2a26\") " pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:22.467563 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.467541 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-spsdn" Jul 27 16:52:22.553919 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.553884 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r69c5" Jul 27 16:52:22.594560 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.594529 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" event={"ID":"642bd38e-7d71-4811-8913-15422048f8cb","Type":"ContainerStarted","Data":"ad767bbaf5480c6dcce076accd7d19f1aa52310facb0dd875ffc1c290f86e7d4"} Jul 27 16:52:22.594689 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.594581 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" event={"ID":"642bd38e-7d71-4811-8913-15422048f8cb","Type":"ContainerStarted","Data":"2ea3341dcfda63549522fd4869a05dc38a47f44a49eb6ddde9591db6167a4cfb"} Jul 27 16:52:22.594689 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.594602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" event={"ID":"642bd38e-7d71-4811-8913-15422048f8cb","Type":"ContainerStarted","Data":"c16b23f2913cb709cb2ff7b4271b6a77656b5dc10a57ce614267249d34ad2552"} Jul 27 16:52:22.598810 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:52:22.598785 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46bb9d73_33bd_40ac_8694_302299aa2a26.slice/crio-e98ee5d148b56ec3d09e4d9fbac2caa42e624fac2777c1814e2cb1776549f1a2 WatchSource:0}: Error finding container e98ee5d148b56ec3d09e4d9fbac2caa42e624fac2777c1814e2cb1776549f1a2: Status 404 returned error can't find the container with id e98ee5d148b56ec3d09e4d9fbac2caa42e624fac2777c1814e2cb1776549f1a2 Jul 27 16:52:22.694136 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.694101 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-764f5c4747-vc9lf"] Jul 27 16:52:22.723496 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.723424 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-764f5c4747-vc9lf"] Jul 27 16:52:22.723627 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.723545 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.726236 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.726213 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 27 16:52:22.726579 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.726557 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-czc65\"" Jul 27 16:52:22.726689 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.726557 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 27 16:52:22.726745 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.726703 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 27 16:52:22.726789 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.726746 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-l5p3esjvor3h\"" Jul 27 16:52:22.727036 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.727019 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 27 16:52:22.727100 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.727020 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 27 16:52:22.758467 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-tls\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.758595 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758474 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.758595 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd985531-b415-4c3e-af59-0f8892e3a6f3-metrics-client-ca\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.758595 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758567 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-grpc-tls\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.758595 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.758803 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxsvq\" (UniqueName: \"kubernetes.io/projected/fd985531-b415-4c3e-af59-0f8892e3a6f3-kube-api-access-fxsvq\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.758803 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.758803 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.758722 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860163 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd985531-b415-4c3e-af59-0f8892e3a6f3-metrics-client-ca\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860163 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860165 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-grpc-tls\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860423 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860423 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860223 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxsvq\" (UniqueName: \"kubernetes.io/projected/fd985531-b415-4c3e-af59-0f8892e3a6f3-kube-api-access-fxsvq\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860423 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860253 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860423 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860309 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860423 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860366 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-tls\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.860423 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.860392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.861322 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.861291 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd985531-b415-4c3e-af59-0f8892e3a6f3-metrics-client-ca\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.863446 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.863413 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.863672 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.863643 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.863875 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.863851 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.864281 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.864260 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.865151 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.865133 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-thanos-querier-tls\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.865316 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.865298 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd985531-b415-4c3e-af59-0f8892e3a6f3-secret-grpc-tls\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:22.875781 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:22.875759 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxsvq\" (UniqueName: \"kubernetes.io/projected/fd985531-b415-4c3e-af59-0f8892e3a6f3-kube-api-access-fxsvq\") pod \"thanos-querier-764f5c4747-vc9lf\" (UID: \"fd985531-b415-4c3e-af59-0f8892e3a6f3\") " pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:23.034031 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:23.033941 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:23.206875 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:23.206840 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-764f5c4747-vc9lf"] Jul 27 16:52:23.211540 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:52:23.211507 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd985531_b415_4c3e_af59_0f8892e3a6f3.slice/crio-e64bbbde97d469dcfae6e19b03e51c44cc1ef6144f50e1bd8621598be52d1db8 WatchSource:0}: Error finding container e64bbbde97d469dcfae6e19b03e51c44cc1ef6144f50e1bd8621598be52d1db8: Status 404 returned error can't find the container with id e64bbbde97d469dcfae6e19b03e51c44cc1ef6144f50e1bd8621598be52d1db8 Jul 27 16:52:23.599963 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:23.599922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r69c5" event={"ID":"46bb9d73-33bd-40ac-8694-302299aa2a26","Type":"ContainerStarted","Data":"e98ee5d148b56ec3d09e4d9fbac2caa42e624fac2777c1814e2cb1776549f1a2"} Jul 27 16:52:23.601303 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:23.601270 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" event={"ID":"fd985531-b415-4c3e-af59-0f8892e3a6f3","Type":"ContainerStarted","Data":"e64bbbde97d469dcfae6e19b03e51c44cc1ef6144f50e1bd8621598be52d1db8"} Jul 27 16:52:24.607936 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.607894 2582 generic.go:356] "Generic (PLEG): container finished" podID="46bb9d73-33bd-40ac-8694-302299aa2a26" containerID="650d7e4b13771af02367b145b9a630206ee17bf605a5d515654d237361988e89" exitCode=0 Jul 27 16:52:24.608395 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.607985 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r69c5" event={"ID":"46bb9d73-33bd-40ac-8694-302299aa2a26","Type":"ContainerDied","Data":"650d7e4b13771af02367b145b9a630206ee17bf605a5d515654d237361988e89"} Jul 27 16:52:24.892115 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.892083 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84b67477df-ng6mj"] Jul 27 16:52:24.913057 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.913029 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84b67477df-ng6mj"] Jul 27 16:52:24.913162 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.913134 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:24.915365 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.915321 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 27 16:52:24.915365 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.915355 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2o079edua3vms\"" Jul 27 16:52:24.915615 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.915405 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 16:52:24.915615 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.915454 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 27 16:52:24.915696 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.915686 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hdsvp\"" Jul 27 16:52:24.915752 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.915737 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 27 16:52:24.978083 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.978037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-metrics-server-audit-profiles\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:24.978171 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.978121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq4fg\" (UniqueName: \"kubernetes.io/projected/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-kube-api-access-cq4fg\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:24.978220 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.978182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-audit-log\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:24.978280 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.978216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-secret-metrics-server-tls\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:24.978280 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.978241 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:24.978382 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.978299 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-secret-metrics-server-client-certs\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:24.978382 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:24.978362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-client-ca-bundle\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.079584 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.079547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-metrics-server-audit-profiles\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.079584 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.079587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq4fg\" (UniqueName: \"kubernetes.io/projected/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-kube-api-access-cq4fg\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.079866 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.079632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-audit-log\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.079866 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.079660 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-secret-metrics-server-tls\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.079866 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.079683 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.079866 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.079732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-secret-metrics-server-client-certs\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.079866 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.079770 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-client-ca-bundle\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.080175 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.080149 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-audit-log\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.080546 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.080490 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.080748 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.080717 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-metrics-server-audit-profiles\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.082808 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.082787 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-client-ca-bundle\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.082934 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.082810 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-secret-metrics-server-tls\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.082934 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.082861 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-secret-metrics-server-client-certs\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.088174 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.088150 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq4fg\" (UniqueName: \"kubernetes.io/projected/75ae5fa0-7f66-4507-a47f-a5ff6877a18d-kube-api-access-cq4fg\") pod \"metrics-server-84b67477df-ng6mj\" (UID: \"75ae5fa0-7f66-4507-a47f-a5ff6877a18d\") " pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.227121 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.227043 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:25.614873 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.614799 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r69c5" event={"ID":"46bb9d73-33bd-40ac-8694-302299aa2a26","Type":"ContainerStarted","Data":"26e7f333dfc12086e1806865d6beab746e4249ce4c5aed083446960a1f9f1e7c"} Jul 27 16:52:25.615318 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.614917 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r69c5" event={"ID":"46bb9d73-33bd-40ac-8694-302299aa2a26","Type":"ContainerStarted","Data":"372417377e2f52a522503e7a6c76e702662d94d9d48eb582f7c87725e606b8d2"} Jul 27 16:52:25.687286 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.687229 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r69c5" podStartSLOduration=4.220205298 podStartE2EDuration="5.687212828s" totalImagesPullingTime="1.341575031s" totalInitContainerRuntime="125.432499ms" isStatefulPod=true podCreationTimestamp="2026-07-27 16:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:52:25.642392123 +0000 UTC m=+103.260096951" watchObservedRunningTime="2026-07-27 16:52:25.687212828 +0000 UTC m=+103.304917667" Jul 27 16:52:25.688947 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:25.688849 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84b67477df-ng6mj"] Jul 27 16:52:25.750303 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:52:25.750267 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ae5fa0_7f66_4507_a47f_a5ff6877a18d.slice/crio-5e8f2f11d577791717c75e5d368b2ed8a567a745236cf86d0e0d0d07dec832b5 WatchSource:0}: Error finding container 5e8f2f11d577791717c75e5d368b2ed8a567a745236cf86d0e0d0d07dec832b5: Status 404 returned error can't find the container with id 5e8f2f11d577791717c75e5d368b2ed8a567a745236cf86d0e0d0d07dec832b5 Jul 27 16:52:26.620116 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:26.620080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" event={"ID":"75ae5fa0-7f66-4507-a47f-a5ff6877a18d","Type":"ContainerStarted","Data":"5e8f2f11d577791717c75e5d368b2ed8a567a745236cf86d0e0d0d07dec832b5"} Jul 27 16:52:26.622229 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:26.622199 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" event={"ID":"fd985531-b415-4c3e-af59-0f8892e3a6f3","Type":"ContainerStarted","Data":"b297d83a4d0c295fb6a3d3730151778489fbbde71f646e1a39afe77d73171f91"} Jul 27 16:52:26.622355 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:26.622272 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" event={"ID":"fd985531-b415-4c3e-af59-0f8892e3a6f3","Type":"ContainerStarted","Data":"cc5c73c4739d32369655813c376b2fff87728bb8246b41b1d5a7dea1764b923e"} Jul 27 16:52:26.622355 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:26.622301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" event={"ID":"fd985531-b415-4c3e-af59-0f8892e3a6f3","Type":"ContainerStarted","Data":"a397379f95bb8cbff1ef6b85fe7e92c4399939038c03312cf525cf8673742ea3"} Jul 27 16:52:26.624322 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:26.624298 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" event={"ID":"642bd38e-7d71-4811-8913-15422048f8cb","Type":"ContainerStarted","Data":"6a186186762d6f59a1584b51427f7f7f98c7d8bbd49f21c1eeb4aa00286caae7"} Jul 27 16:52:26.645047 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:26.644999 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gv98s" podStartSLOduration=3.89227999 podStartE2EDuration="6.644983983s" totalImagesPullingTime="2.752703993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:52:26.643636929 +0000 UTC m=+104.261341731" watchObservedRunningTime="2026-07-27 16:52:26.644983983 +0000 UTC m=+104.262688806" Jul 27 16:52:27.630712 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:27.630679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" event={"ID":"fd985531-b415-4c3e-af59-0f8892e3a6f3","Type":"ContainerStarted","Data":"609eb283a523030232dfa7ea8328de097c0633ab107a11d55855377c35f01d54"} Jul 27 16:52:28.637454 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:28.637421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" event={"ID":"fd985531-b415-4c3e-af59-0f8892e3a6f3","Type":"ContainerStarted","Data":"bab8905a25a8fbc97838590bc2897f9c4d4035d2874564056b88d3cdcdb3aa94"} Jul 27 16:52:28.637807 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:28.637484 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" event={"ID":"fd985531-b415-4c3e-af59-0f8892e3a6f3","Type":"ContainerStarted","Data":"85a5002cb35c3127849b757308160852abcf649539e296aa4797b45573d819cb"} Jul 27 16:52:28.637807 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:28.637592 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:28.661209 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:28.661161 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" podStartSLOduration=2.7609764180000003 podStartE2EDuration="6.661145153s" totalImagesPullingTime="3.900168735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:52:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:52:28.659380679 +0000 UTC m=+106.277085501" watchObservedRunningTime="2026-07-27 16:52:28.661145153 +0000 UTC m=+106.278849957" Jul 27 16:52:29.643767 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:29.643727 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" event={"ID":"75ae5fa0-7f66-4507-a47f-a5ff6877a18d","Type":"ContainerStarted","Data":"d3b7df38556aefb0259f67c34599aa008027bea65a16b6b80874743b61f5ebc6"} Jul 27 16:52:29.667677 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:29.667623 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" podStartSLOduration=2.659346909 podStartE2EDuration="5.667607582s" totalImagesPullingTime="3.008260673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:52:29.665689617 +0000 UTC m=+107.283394418" watchObservedRunningTime="2026-07-27 16:52:29.667607582 +0000 UTC m=+107.285312383" Jul 27 16:52:33.660980 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:33.660947 2582 generic.go:356] "Generic (PLEG): container finished" podID="f71bdb77-5c80-44eb-be60-d16602467705" containerID="09148559a7141d1e13754171858c109e88e64bf6cbc24060377ece6842ca04d0" exitCode=0 Jul 27 16:52:33.660980 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:33.660983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" event={"ID":"f71bdb77-5c80-44eb-be60-d16602467705","Type":"ContainerDied","Data":"09148559a7141d1e13754171858c109e88e64bf6cbc24060377ece6842ca04d0"} Jul 27 16:52:33.661391 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:33.661276 2582 scope.go:117] "RemoveContainer" containerID="09148559a7141d1e13754171858c109e88e64bf6cbc24060377ece6842ca04d0" Jul 27 16:52:34.651156 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:34.651122 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-764f5c4747-vc9lf" Jul 27 16:52:34.666171 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:34.666140 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm" event={"ID":"f71bdb77-5c80-44eb-be60-d16602467705","Type":"ContainerStarted","Data":"d9c4f60ce3c542265af550c04b5b9a89f69a91dd50f2708472102ac333491e03"} Jul 27 16:52:38.221861 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.221792 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" podUID="674234bf-6e5b-48fa-833f-be4cb0599e62" containerName="registry" containerID="cri-o://6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6" gracePeriod=30 Jul 27 16:52:38.464528 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.464504 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:52:38.504477 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504448 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-installation-pull-secrets\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.504621 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504484 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-image-registry-private-configuration\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.504621 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504517 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-bound-sa-token\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.504621 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504549 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/674234bf-6e5b-48fa-833f-be4cb0599e62-ca-trust-extracted\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.504621 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504583 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-trusted-ca\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.504863 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504633 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-certificates\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.504863 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504664 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jks2c\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-kube-api-access-jks2c\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.504863 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.504724 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") pod \"674234bf-6e5b-48fa-833f-be4cb0599e62\" (UID: \"674234bf-6e5b-48fa-833f-be4cb0599e62\") " Jul 27 16:52:38.505652 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.505342 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:52:38.505652 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.505562 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:52:38.507382 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.507339 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:52:38.507493 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.507391 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:52:38.507493 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.507466 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:52:38.507638 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.507614 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:52:38.507761 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.507743 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-kube-api-access-jks2c" (OuterVolumeSpecName: "kube-api-access-jks2c") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "kube-api-access-jks2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:52:38.515442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.515418 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674234bf-6e5b-48fa-833f-be4cb0599e62-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "674234bf-6e5b-48fa-833f-be4cb0599e62" (UID: "674234bf-6e5b-48fa-833f-be4cb0599e62"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:52:38.605879 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605809 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-bound-sa-token\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.605879 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605873 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/674234bf-6e5b-48fa-833f-be4cb0599e62-ca-trust-extracted\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.605879 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605885 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-trusted-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.605879 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605894 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-certificates\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.606143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605904 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jks2c\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-kube-api-access-jks2c\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.606143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605913 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/674234bf-6e5b-48fa-833f-be4cb0599e62-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.606143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605922 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-installation-pull-secrets\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.606143 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.605931 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/674234bf-6e5b-48fa-833f-be4cb0599e62-image-registry-private-configuration\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:52:38.683097 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.683015 2582 generic.go:356] "Generic (PLEG): container finished" podID="156d3618-4e03-48d3-8457-c797d18b808d" containerID="17e503f5d807dd7d44826067dd249cf0c924fa5c189f7389662ad79acbb67f8a" exitCode=0 Jul 27 16:52:38.683239 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.683088 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" event={"ID":"156d3618-4e03-48d3-8457-c797d18b808d","Type":"ContainerDied","Data":"17e503f5d807dd7d44826067dd249cf0c924fa5c189f7389662ad79acbb67f8a"} Jul 27 16:52:38.683460 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.683445 2582 scope.go:117] "RemoveContainer" containerID="17e503f5d807dd7d44826067dd249cf0c924fa5c189f7389662ad79acbb67f8a" Jul 27 16:52:38.684371 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.684350 2582 generic.go:356] "Generic (PLEG): container finished" podID="674234bf-6e5b-48fa-833f-be4cb0599e62" containerID="6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6" exitCode=0 Jul 27 16:52:38.684450 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.684390 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" Jul 27 16:52:38.684450 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.684422 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" event={"ID":"674234bf-6e5b-48fa-833f-be4cb0599e62","Type":"ContainerDied","Data":"6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6"} Jul 27 16:52:38.684748 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.684689 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74bb6776d4-5pm8p" event={"ID":"674234bf-6e5b-48fa-833f-be4cb0599e62","Type":"ContainerDied","Data":"a812486e4967c2fb7974a9081a408c33a98c5b248a23bf9fab01f4bb5d3ac43e"} Jul 27 16:52:38.687682 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.684934 2582 scope.go:117] "RemoveContainer" containerID="6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6" Jul 27 16:52:38.698868 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.698852 2582 scope.go:117] "RemoveContainer" containerID="6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6" Jul 27 16:52:38.699138 ip-10-0-141-8 kubenswrapper[2582]: E0727 16:52:38.699114 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6\": container with ID starting with 6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6 not found: ID does not exist" containerID="6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6" Jul 27 16:52:38.699211 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.699151 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6"} err="failed to get container status \"6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6\": rpc error: code = NotFound desc = could not find container \"6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6\": container with ID starting with 6f878b60a736b7b77d1c68c109a789f8a1f45bc4f3c035e65040b6ffb41919a6 not found: ID does not exist" Jul 27 16:52:38.717175 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.717147 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74bb6776d4-5pm8p"] Jul 27 16:52:38.723238 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:38.723211 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74bb6776d4-5pm8p"] Jul 27 16:52:39.029229 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:39.029155 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674234bf-6e5b-48fa-833f-be4cb0599e62" path="/var/lib/kubelet/pods/674234bf-6e5b-48fa-833f-be4cb0599e62/volumes" Jul 27 16:52:39.689937 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:39.689900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7tprd" event={"ID":"156d3618-4e03-48d3-8457-c797d18b808d","Type":"ContainerStarted","Data":"ed5098cd118cfc3add8130beec42f3ecc4bcc43895598d65e69519c4186e5a4b"} Jul 27 16:52:45.227539 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:45.227511 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:45.227982 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:45.227580 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:52:59.775450 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:59.775416 2582 generic.go:356] "Generic (PLEG): container finished" podID="0b45b08f-5c6e-4445-8745-646eb7af6e34" containerID="5aeab5565f4f6ec2d73f2ebe0b50f9d1794f7225fe1691687b493ed85d231d69" exitCode=0 Jul 27 16:52:59.775848 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:59.775492 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hsfsj" event={"ID":"0b45b08f-5c6e-4445-8745-646eb7af6e34","Type":"ContainerDied","Data":"5aeab5565f4f6ec2d73f2ebe0b50f9d1794f7225fe1691687b493ed85d231d69"} Jul 27 16:52:59.775898 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:52:59.775877 2582 scope.go:117] "RemoveContainer" containerID="5aeab5565f4f6ec2d73f2ebe0b50f9d1794f7225fe1691687b493ed85d231d69" Jul 27 16:53:00.781517 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:53:00.781481 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hsfsj" event={"ID":"0b45b08f-5c6e-4445-8745-646eb7af6e34","Type":"ContainerStarted","Data":"e86d4cb62909080b7eba44f8fafa4a1f7da37e39de518fcbbbc85794ca4ee67f"} Jul 27 16:53:05.232904 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:53:05.232875 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:53:05.236722 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:53:05.236696 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84b67477df-ng6mj" Jul 27 16:55:42.806076 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:55:42.806045 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 16:55:42.815440 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:55:42.815400 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 16:55:42.816608 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:55:42.816587 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 16:56:02.756150 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.756112 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld"] Jul 27 16:56:02.758546 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.756444 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674234bf-6e5b-48fa-833f-be4cb0599e62" containerName="registry" Jul 27 16:56:02.758546 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.756456 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="674234bf-6e5b-48fa-833f-be4cb0599e62" containerName="registry" Jul 27 16:56:02.758546 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.756508 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="674234bf-6e5b-48fa-833f-be4cb0599e62" containerName="registry" Jul 27 16:56:02.759267 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.759252 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.761469 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.761446 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 16:56:02.761605 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.761447 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hg86\"" Jul 27 16:56:02.762063 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.762047 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 16:56:02.768739 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.768715 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld"] Jul 27 16:56:02.840952 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.840912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.841163 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.840967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.841163 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.841068 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twwnx\" (UniqueName: \"kubernetes.io/projected/30208029-57d7-4976-8b58-1e0a6d7eecf1-kube-api-access-twwnx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.941465 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.941428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.941654 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.941517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twwnx\" (UniqueName: \"kubernetes.io/projected/30208029-57d7-4976-8b58-1e0a6d7eecf1-kube-api-access-twwnx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.941654 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.941569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.941887 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.941859 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.941887 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.941874 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:02.951965 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:02.951931 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twwnx\" (UniqueName: \"kubernetes.io/projected/30208029-57d7-4976-8b58-1e0a6d7eecf1-kube-api-access-twwnx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:03.068305 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:03.068257 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:03.203284 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:03.203260 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld"] Jul 27 16:56:03.205830 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:56:03.205788 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30208029_57d7_4976_8b58_1e0a6d7eecf1.slice/crio-3a6c09fc9fb596f9e73009ca3026205fa292ca50fec1cd8fb15fe20865e5bf4c WatchSource:0}: Error finding container 3a6c09fc9fb596f9e73009ca3026205fa292ca50fec1cd8fb15fe20865e5bf4c: Status 404 returned error can't find the container with id 3a6c09fc9fb596f9e73009ca3026205fa292ca50fec1cd8fb15fe20865e5bf4c Jul 27 16:56:03.208049 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:03.208031 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:56:03.474713 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:03.474630 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" event={"ID":"30208029-57d7-4976-8b58-1e0a6d7eecf1","Type":"ContainerStarted","Data":"3a6c09fc9fb596f9e73009ca3026205fa292ca50fec1cd8fb15fe20865e5bf4c"} Jul 27 16:56:10.513228 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:10.513186 2582 generic.go:356] "Generic (PLEG): container finished" podID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerID="8dc0efcc310c26eac7a46aaf6b5633b68464cc0b1b65c3754b1ba4f66c00fcd0" exitCode=0 Jul 27 16:56:10.513679 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:10.513270 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" event={"ID":"30208029-57d7-4976-8b58-1e0a6d7eecf1","Type":"ContainerDied","Data":"8dc0efcc310c26eac7a46aaf6b5633b68464cc0b1b65c3754b1ba4f66c00fcd0"} Jul 27 16:56:13.528157 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:13.528122 2582 generic.go:356] "Generic (PLEG): container finished" podID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerID="4f78d403fd6711a7c1e99d8af271dafe241f18fc1bdac118bf962e2022e4b869" exitCode=0 Jul 27 16:56:13.528540 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:13.528215 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" event={"ID":"30208029-57d7-4976-8b58-1e0a6d7eecf1","Type":"ContainerDied","Data":"4f78d403fd6711a7c1e99d8af271dafe241f18fc1bdac118bf962e2022e4b869"} Jul 27 16:56:21.573432 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:21.573399 2582 generic.go:356] "Generic (PLEG): container finished" podID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerID="46e5e96031ca31cab0a3d6ecd22c5ae64f1a72cc92e32f7ef0da55ee43a561cf" exitCode=0 Jul 27 16:56:21.573791 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:21.573449 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" event={"ID":"30208029-57d7-4976-8b58-1e0a6d7eecf1","Type":"ContainerDied","Data":"46e5e96031ca31cab0a3d6ecd22c5ae64f1a72cc92e32f7ef0da55ee43a561cf"} Jul 27 16:56:22.703427 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.703403 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:22.713295 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.713273 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-util\") pod \"30208029-57d7-4976-8b58-1e0a6d7eecf1\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " Jul 27 16:56:22.713552 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.713305 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-bundle\") pod \"30208029-57d7-4976-8b58-1e0a6d7eecf1\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " Jul 27 16:56:22.713552 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.713368 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twwnx\" (UniqueName: \"kubernetes.io/projected/30208029-57d7-4976-8b58-1e0a6d7eecf1-kube-api-access-twwnx\") pod \"30208029-57d7-4976-8b58-1e0a6d7eecf1\" (UID: \"30208029-57d7-4976-8b58-1e0a6d7eecf1\") " Jul 27 16:56:22.714105 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.714081 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-bundle" (OuterVolumeSpecName: "bundle") pod "30208029-57d7-4976-8b58-1e0a6d7eecf1" (UID: "30208029-57d7-4976-8b58-1e0a6d7eecf1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:56:22.715453 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.715424 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30208029-57d7-4976-8b58-1e0a6d7eecf1-kube-api-access-twwnx" (OuterVolumeSpecName: "kube-api-access-twwnx") pod "30208029-57d7-4976-8b58-1e0a6d7eecf1" (UID: "30208029-57d7-4976-8b58-1e0a6d7eecf1"). InnerVolumeSpecName "kube-api-access-twwnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:56:22.717753 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.717730 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-util" (OuterVolumeSpecName: "util") pod "30208029-57d7-4976-8b58-1e0a6d7eecf1" (UID: "30208029-57d7-4976-8b58-1e0a6d7eecf1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:56:22.814368 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.814337 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-util\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:56:22.814368 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.814362 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30208029-57d7-4976-8b58-1e0a6d7eecf1-bundle\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:56:22.814368 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:22.814374 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twwnx\" (UniqueName: \"kubernetes.io/projected/30208029-57d7-4976-8b58-1e0a6d7eecf1-kube-api-access-twwnx\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:56:23.582467 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:23.582433 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" event={"ID":"30208029-57d7-4976-8b58-1e0a6d7eecf1","Type":"ContainerDied","Data":"3a6c09fc9fb596f9e73009ca3026205fa292ca50fec1cd8fb15fe20865e5bf4c"} Jul 27 16:56:23.582630 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:23.582485 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a6c09fc9fb596f9e73009ca3026205fa292ca50fec1cd8fb15fe20865e5bf4c" Jul 27 16:56:23.582630 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:23.582447 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nz4ld" Jul 27 16:56:31.206760 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.206720 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw"] Jul 27 16:56:31.207360 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.207188 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerName="util" Jul 27 16:56:31.207360 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.207206 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerName="util" Jul 27 16:56:31.207360 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.207234 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerName="pull" Jul 27 16:56:31.207360 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.207243 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerName="pull" Jul 27 16:56:31.207360 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.207253 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerName="extract" Jul 27 16:56:31.207360 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.207261 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerName="extract" Jul 27 16:56:31.207360 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.207338 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="30208029-57d7-4976-8b58-1e0a6d7eecf1" containerName="extract" Jul 27 16:56:31.210552 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.210531 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.212988 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.212953 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:56:31.212988 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.212952 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-72qvf\"" Jul 27 16:56:31.213214 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.213066 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 27 16:56:31.225111 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.225087 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw"] Jul 27 16:56:31.284159 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.284117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtbvx\" (UniqueName: \"kubernetes.io/projected/23eaeb5b-2811-4ab5-adc0-523b522ffe0c-kube-api-access-rtbvx\") pod \"cert-manager-operator-controller-manager-56b4598547-n6bkw\" (UID: \"23eaeb5b-2811-4ab5-adc0-523b522ffe0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.284352 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.284183 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23eaeb5b-2811-4ab5-adc0-523b522ffe0c-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-n6bkw\" (UID: \"23eaeb5b-2811-4ab5-adc0-523b522ffe0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.385190 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.385157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbvx\" (UniqueName: \"kubernetes.io/projected/23eaeb5b-2811-4ab5-adc0-523b522ffe0c-kube-api-access-rtbvx\") pod \"cert-manager-operator-controller-manager-56b4598547-n6bkw\" (UID: \"23eaeb5b-2811-4ab5-adc0-523b522ffe0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.385366 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.385214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23eaeb5b-2811-4ab5-adc0-523b522ffe0c-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-n6bkw\" (UID: \"23eaeb5b-2811-4ab5-adc0-523b522ffe0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.385554 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.385536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23eaeb5b-2811-4ab5-adc0-523b522ffe0c-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-n6bkw\" (UID: \"23eaeb5b-2811-4ab5-adc0-523b522ffe0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.393965 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.393939 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtbvx\" (UniqueName: \"kubernetes.io/projected/23eaeb5b-2811-4ab5-adc0-523b522ffe0c-kube-api-access-rtbvx\") pod \"cert-manager-operator-controller-manager-56b4598547-n6bkw\" (UID: \"23eaeb5b-2811-4ab5-adc0-523b522ffe0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.519998 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.519900 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" Jul 27 16:56:31.667121 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:31.667083 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw"] Jul 27 16:56:31.671776 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:56:31.671743 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23eaeb5b_2811_4ab5_adc0_523b522ffe0c.slice/crio-119717f4be9722eb38f521eeb18bca4def87dd85980cf7490ad146cfeef69d98 WatchSource:0}: Error finding container 119717f4be9722eb38f521eeb18bca4def87dd85980cf7490ad146cfeef69d98: Status 404 returned error can't find the container with id 119717f4be9722eb38f521eeb18bca4def87dd85980cf7490ad146cfeef69d98 Jul 27 16:56:32.621390 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:32.621347 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" event={"ID":"23eaeb5b-2811-4ab5-adc0-523b522ffe0c","Type":"ContainerStarted","Data":"119717f4be9722eb38f521eeb18bca4def87dd85980cf7490ad146cfeef69d98"} Jul 27 16:56:33.628883 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:33.628846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" event={"ID":"23eaeb5b-2811-4ab5-adc0-523b522ffe0c","Type":"ContainerStarted","Data":"e0c9e8bee129abf452597e63ea48590bf46c8de75672d5dc13659f806a214844"} Jul 27 16:56:33.651216 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:33.651149 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-n6bkw" podStartSLOduration=1.047395014 podStartE2EDuration="2.651130488s" totalImagesPullingTime="1.603735474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:56:33.649359708 +0000 UTC m=+351.267064509" watchObservedRunningTime="2026-07-27 16:56:33.651130488 +0000 UTC m=+351.268835290" Jul 27 16:56:35.130328 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.130297 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n8tff"] Jul 27 16:56:35.132442 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.132423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.134513 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.134491 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 16:56:35.134513 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.134505 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 16:56:35.144219 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.144198 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n8tff"] Jul 27 16:56:35.218382 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.218301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zps4g\" (UniqueName: \"kubernetes.io/projected/82b56270-af2e-407c-a4ff-1333cfd40b0b-kube-api-access-zps4g\") pod \"cert-manager-webhook-6486ffd997-n8tff\" (UID: \"82b56270-af2e-407c-a4ff-1333cfd40b0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.218382 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.218346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b56270-af2e-407c-a4ff-1333cfd40b0b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n8tff\" (UID: \"82b56270-af2e-407c-a4ff-1333cfd40b0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.319544 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.319502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b56270-af2e-407c-a4ff-1333cfd40b0b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n8tff\" (UID: \"82b56270-af2e-407c-a4ff-1333cfd40b0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.319738 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.319606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zps4g\" (UniqueName: \"kubernetes.io/projected/82b56270-af2e-407c-a4ff-1333cfd40b0b-kube-api-access-zps4g\") pod \"cert-manager-webhook-6486ffd997-n8tff\" (UID: \"82b56270-af2e-407c-a4ff-1333cfd40b0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.327673 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.327644 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82b56270-af2e-407c-a4ff-1333cfd40b0b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n8tff\" (UID: \"82b56270-af2e-407c-a4ff-1333cfd40b0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.327790 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.327768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zps4g\" (UniqueName: \"kubernetes.io/projected/82b56270-af2e-407c-a4ff-1333cfd40b0b-kube-api-access-zps4g\") pod \"cert-manager-webhook-6486ffd997-n8tff\" (UID: \"82b56270-af2e-407c-a4ff-1333cfd40b0b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.454200 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.454119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:35.583166 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.583140 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n8tff"] Jul 27 16:56:35.585433 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:56:35.585407 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82b56270_af2e_407c_a4ff_1333cfd40b0b.slice/crio-8eac004555f0af9f34d3c13c6441facc4be84629e5f099c460a08cd65ef911b0 WatchSource:0}: Error finding container 8eac004555f0af9f34d3c13c6441facc4be84629e5f099c460a08cd65ef911b0: Status 404 returned error can't find the container with id 8eac004555f0af9f34d3c13c6441facc4be84629e5f099c460a08cd65ef911b0 Jul 27 16:56:35.638655 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:35.638620 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" event={"ID":"82b56270-af2e-407c-a4ff-1333cfd40b0b","Type":"ContainerStarted","Data":"8eac004555f0af9f34d3c13c6441facc4be84629e5f099c460a08cd65ef911b0"} Jul 27 16:56:38.654698 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:38.654660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" event={"ID":"82b56270-af2e-407c-a4ff-1333cfd40b0b","Type":"ContainerStarted","Data":"3a5dcbbceec7dc2bc6db7a6a258311a0bf0c510046823deef1363e36938da57f"} Jul 27 16:56:38.655107 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:38.654742 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:38.672320 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:38.672271 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" podStartSLOduration=1.138589784 podStartE2EDuration="3.672255335s" totalImagesPullingTime="2.533665551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:56:38.670770872 +0000 UTC m=+356.288475688" watchObservedRunningTime="2026-07-27 16:56:38.672255335 +0000 UTC m=+356.289960136" Jul 27 16:56:44.661328 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:44.661278 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-n8tff" Jul 27 16:56:48.405692 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.405648 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s4mzf"] Jul 27 16:56:48.407905 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.407888 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.410125 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.410106 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-svchp\"" Jul 27 16:56:48.419281 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.419258 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s4mzf"] Jul 27 16:56:48.529912 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.529876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54c79b55-6a59-4c44-a20a-be78df07a0ed-bound-sa-token\") pod \"cert-manager-55b4d954d5-s4mzf\" (UID: \"54c79b55-6a59-4c44-a20a-be78df07a0ed\") " pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.530083 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.529934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64sc\" (UniqueName: \"kubernetes.io/projected/54c79b55-6a59-4c44-a20a-be78df07a0ed-kube-api-access-m64sc\") pod \"cert-manager-55b4d954d5-s4mzf\" (UID: \"54c79b55-6a59-4c44-a20a-be78df07a0ed\") " pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.631159 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.631130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54c79b55-6a59-4c44-a20a-be78df07a0ed-bound-sa-token\") pod \"cert-manager-55b4d954d5-s4mzf\" (UID: \"54c79b55-6a59-4c44-a20a-be78df07a0ed\") " pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.631323 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.631188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64sc\" (UniqueName: \"kubernetes.io/projected/54c79b55-6a59-4c44-a20a-be78df07a0ed-kube-api-access-m64sc\") pod \"cert-manager-55b4d954d5-s4mzf\" (UID: \"54c79b55-6a59-4c44-a20a-be78df07a0ed\") " pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.639486 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.639454 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54c79b55-6a59-4c44-a20a-be78df07a0ed-bound-sa-token\") pod \"cert-manager-55b4d954d5-s4mzf\" (UID: \"54c79b55-6a59-4c44-a20a-be78df07a0ed\") " pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.639649 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.639627 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64sc\" (UniqueName: \"kubernetes.io/projected/54c79b55-6a59-4c44-a20a-be78df07a0ed-kube-api-access-m64sc\") pod \"cert-manager-55b4d954d5-s4mzf\" (UID: \"54c79b55-6a59-4c44-a20a-be78df07a0ed\") " pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.717450 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.717370 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s4mzf" Jul 27 16:56:48.847230 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:48.847201 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s4mzf"] Jul 27 16:56:48.849619 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:56:48.849590 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54c79b55_6a59_4c44_a20a_be78df07a0ed.slice/crio-edd89d935000f4ca29d4e5c6d5adad2b1459359abfff8e18bad3e0713bf05c8c WatchSource:0}: Error finding container edd89d935000f4ca29d4e5c6d5adad2b1459359abfff8e18bad3e0713bf05c8c: Status 404 returned error can't find the container with id edd89d935000f4ca29d4e5c6d5adad2b1459359abfff8e18bad3e0713bf05c8c Jul 27 16:56:49.706781 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:49.706740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s4mzf" event={"ID":"54c79b55-6a59-4c44-a20a-be78df07a0ed","Type":"ContainerStarted","Data":"ee37d8df3cbc6dba59255275b4bef10e1429257ef4db0695beb5986d0ade8a6b"} Jul 27 16:56:49.706781 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:49.706792 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s4mzf" event={"ID":"54c79b55-6a59-4c44-a20a-be78df07a0ed","Type":"ContainerStarted","Data":"edd89d935000f4ca29d4e5c6d5adad2b1459359abfff8e18bad3e0713bf05c8c"} Jul 27 16:56:49.724430 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:49.724377 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-s4mzf" podStartSLOduration=1.724362902 podStartE2EDuration="1.724362902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:56:49.722900153 +0000 UTC m=+367.340604956" watchObservedRunningTime="2026-07-27 16:56:49.724362902 +0000 UTC m=+367.342067705" Jul 27 16:56:50.824948 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.824916 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb"] Jul 27 16:56:50.827625 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.827610 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:50.830020 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.830000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hg86\"" Jul 27 16:56:50.830020 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.830013 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 16:56:50.830295 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.830280 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 16:56:50.837344 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.837323 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb"] Jul 27 16:56:50.950215 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.950181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:50.950385 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.950239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l6fh\" (UniqueName: \"kubernetes.io/projected/09e0c85b-bcee-4bda-8437-e9d778267417-kube-api-access-5l6fh\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:50.950385 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:50.950317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.051169 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.051133 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.051355 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.051192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l6fh\" (UniqueName: \"kubernetes.io/projected/09e0c85b-bcee-4bda-8437-e9d778267417-kube-api-access-5l6fh\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.051355 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.051246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.051545 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.051509 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.051618 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.051578 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.059523 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.059499 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l6fh\" (UniqueName: \"kubernetes.io/projected/09e0c85b-bcee-4bda-8437-e9d778267417-kube-api-access-5l6fh\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.137504 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.137397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:56:51.268125 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.268100 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb"] Jul 27 16:56:51.270474 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:56:51.270442 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e0c85b_bcee_4bda_8437_e9d778267417.slice/crio-e582368b6996ca66fd5cdb5a0aca9e035efb0a936374ebcfff166a70370bba0d WatchSource:0}: Error finding container e582368b6996ca66fd5cdb5a0aca9e035efb0a936374ebcfff166a70370bba0d: Status 404 returned error can't find the container with id e582368b6996ca66fd5cdb5a0aca9e035efb0a936374ebcfff166a70370bba0d Jul 27 16:56:51.717128 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.717096 2582 generic.go:356] "Generic (PLEG): container finished" podID="09e0c85b-bcee-4bda-8437-e9d778267417" containerID="18f128ad95189424a969fc47673336edf85695050b48a5a4adc929dab9d2d819" exitCode=0 Jul 27 16:56:51.717306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.717134 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" event={"ID":"09e0c85b-bcee-4bda-8437-e9d778267417","Type":"ContainerDied","Data":"18f128ad95189424a969fc47673336edf85695050b48a5a4adc929dab9d2d819"} Jul 27 16:56:51.717306 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:56:51.717170 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" event={"ID":"09e0c85b-bcee-4bda-8437-e9d778267417","Type":"ContainerStarted","Data":"e582368b6996ca66fd5cdb5a0aca9e035efb0a936374ebcfff166a70370bba0d"} Jul 27 16:57:14.823391 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:14.823352 2582 generic.go:356] "Generic (PLEG): container finished" podID="09e0c85b-bcee-4bda-8437-e9d778267417" containerID="a75f832a48d7e9ec235b319e5e7307276bde7b49d1ae6264bc1c798b271f1cba" exitCode=0 Jul 27 16:57:14.823797 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:14.823413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" event={"ID":"09e0c85b-bcee-4bda-8437-e9d778267417","Type":"ContainerDied","Data":"a75f832a48d7e9ec235b319e5e7307276bde7b49d1ae6264bc1c798b271f1cba"} Jul 27 16:57:15.832249 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:15.832209 2582 generic.go:356] "Generic (PLEG): container finished" podID="09e0c85b-bcee-4bda-8437-e9d778267417" containerID="b8282fac5c9de05671e05dc3349b4441755b7666ffac7c289e0c878adffce556" exitCode=0 Jul 27 16:57:15.832658 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:15.832295 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" event={"ID":"09e0c85b-bcee-4bda-8437-e9d778267417","Type":"ContainerDied","Data":"b8282fac5c9de05671e05dc3349b4441755b7666ffac7c289e0c878adffce556"} Jul 27 16:57:16.960787 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:16.960757 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:57:16.970206 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:16.970185 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-util\") pod \"09e0c85b-bcee-4bda-8437-e9d778267417\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " Jul 27 16:57:16.970325 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:16.970215 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l6fh\" (UniqueName: \"kubernetes.io/projected/09e0c85b-bcee-4bda-8437-e9d778267417-kube-api-access-5l6fh\") pod \"09e0c85b-bcee-4bda-8437-e9d778267417\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " Jul 27 16:57:16.970325 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:16.970253 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-bundle\") pod \"09e0c85b-bcee-4bda-8437-e9d778267417\" (UID: \"09e0c85b-bcee-4bda-8437-e9d778267417\") " Jul 27 16:57:16.970668 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:16.970643 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-bundle" (OuterVolumeSpecName: "bundle") pod "09e0c85b-bcee-4bda-8437-e9d778267417" (UID: "09e0c85b-bcee-4bda-8437-e9d778267417"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:57:16.972309 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:16.972289 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e0c85b-bcee-4bda-8437-e9d778267417-kube-api-access-5l6fh" (OuterVolumeSpecName: "kube-api-access-5l6fh") pod "09e0c85b-bcee-4bda-8437-e9d778267417" (UID: "09e0c85b-bcee-4bda-8437-e9d778267417"). InnerVolumeSpecName "kube-api-access-5l6fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:57:16.974799 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:16.974780 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-util" (OuterVolumeSpecName: "util") pod "09e0c85b-bcee-4bda-8437-e9d778267417" (UID: "09e0c85b-bcee-4bda-8437-e9d778267417"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:57:17.070927 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:17.070898 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-util\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:57:17.070927 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:17.070922 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l6fh\" (UniqueName: \"kubernetes.io/projected/09e0c85b-bcee-4bda-8437-e9d778267417-kube-api-access-5l6fh\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:57:17.070927 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:17.070934 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09e0c85b-bcee-4bda-8437-e9d778267417-bundle\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 16:57:17.843395 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:17.843359 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" event={"ID":"09e0c85b-bcee-4bda-8437-e9d778267417","Type":"ContainerDied","Data":"e582368b6996ca66fd5cdb5a0aca9e035efb0a936374ebcfff166a70370bba0d"} Jul 27 16:57:17.843564 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:17.843409 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e582368b6996ca66fd5cdb5a0aca9e035efb0a936374ebcfff166a70370bba0d" Jul 27 16:57:17.843564 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:57:17.843371 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ecm6xb" Jul 27 16:58:23.470639 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.470598 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx"] Jul 27 16:58:23.471091 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.470938 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e0c85b-bcee-4bda-8437-e9d778267417" containerName="pull" Jul 27 16:58:23.471091 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.470950 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e0c85b-bcee-4bda-8437-e9d778267417" containerName="pull" Jul 27 16:58:23.471091 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.470967 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e0c85b-bcee-4bda-8437-e9d778267417" containerName="extract" Jul 27 16:58:23.471091 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.470972 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e0c85b-bcee-4bda-8437-e9d778267417" containerName="extract" Jul 27 16:58:23.471091 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.470982 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e0c85b-bcee-4bda-8437-e9d778267417" containerName="util" Jul 27 16:58:23.471091 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.470989 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e0c85b-bcee-4bda-8437-e9d778267417" containerName="util" Jul 27 16:58:23.471091 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.471042 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="09e0c85b-bcee-4bda-8437-e9d778267417" containerName="extract" Jul 27 16:58:23.473939 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.473923 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.476071 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.476048 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-tlbpk\"" Jul 27 16:58:23.476668 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.476646 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 27 16:58:23.476755 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.476646 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 27 16:58:23.486224 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.486205 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx"] Jul 27 16:58:23.603951 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.603907 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.603951 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.603950 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwnnd\" (UniqueName: \"kubernetes.io/projected/25414aa6-0020-45d1-b0c7-c04b6c73acd7-kube-api-access-cwnnd\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.604194 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.604006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.704978 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.704936 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.705147 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.705051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.705147 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.705080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwnnd\" (UniqueName: \"kubernetes.io/projected/25414aa6-0020-45d1-b0c7-c04b6c73acd7-kube-api-access-cwnnd\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.705412 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.705391 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.705449 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.705395 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.713546 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.713516 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwnnd\" (UniqueName: \"kubernetes.io/projected/25414aa6-0020-45d1-b0c7-c04b6c73acd7-kube-api-access-cwnnd\") pod \"trainer-operator-controller-manager-56f5b7fd56-6c4vx\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.783975 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.783894 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:23.919598 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:23.919573 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx"] Jul 27 16:58:23.921979 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:58:23.921951 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25414aa6_0020_45d1_b0c7_c04b6c73acd7.slice/crio-297c8708bc4f1a1c0ab6f366080ed1029cf5c419746a494d3af2c177135a27e0 WatchSource:0}: Error finding container 297c8708bc4f1a1c0ab6f366080ed1029cf5c419746a494d3af2c177135a27e0: Status 404 returned error can't find the container with id 297c8708bc4f1a1c0ab6f366080ed1029cf5c419746a494d3af2c177135a27e0 Jul 27 16:58:24.129701 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:24.129663 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" event={"ID":"25414aa6-0020-45d1-b0c7-c04b6c73acd7","Type":"ContainerStarted","Data":"297c8708bc4f1a1c0ab6f366080ed1029cf5c419746a494d3af2c177135a27e0"} Jul 27 16:58:27.147080 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:27.147041 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" event={"ID":"25414aa6-0020-45d1-b0c7-c04b6c73acd7","Type":"ContainerStarted","Data":"5afef404626a2c5fbf5911db0084068dac4e2c5bde926f5e1db82a02bae9e393"} Jul 27 16:58:27.147483 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:27.147165 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:58:27.163466 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:27.163406 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" podStartSLOduration=1.850817885 podStartE2EDuration="4.163388658s" totalImagesPullingTime="2.312570773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:58:27.161908199 +0000 UTC m=+464.779613016" watchObservedRunningTime="2026-07-27 16:58:27.163388658 +0000 UTC m=+464.781093471" Jul 27 16:58:38.154619 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:58:38.154587 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 16:59:11.779181 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.779145 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g"] Jul 27 16:59:11.783662 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.783643 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:11.786257 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.786231 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 27 16:59:11.786549 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.786516 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 16:59:11.786671 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.786655 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 16:59:11.787167 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.787150 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 27 16:59:11.787217 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.787194 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-7cglh\"" Jul 27 16:59:11.795708 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.795683 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g"] Jul 27 16:59:11.904598 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.904567 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0e84c9a-6988-45f0-bf3a-646f281de5eb-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:11.904781 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.904636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:11.904781 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:11.904681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t686v\" (UniqueName: \"kubernetes.io/projected/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kube-api-access-t686v\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.006139 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.006100 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.006296 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.006149 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t686v\" (UniqueName: \"kubernetes.io/projected/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kube-api-access-t686v\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.006296 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.006182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0e84c9a-6988-45f0-bf3a-646f281de5eb-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.006920 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.006897 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.008461 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.008439 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0e84c9a-6988-45f0-bf3a-646f281de5eb-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.019772 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.019748 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t686v\" (UniqueName: \"kubernetes.io/projected/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kube-api-access-t686v\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.092998 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.092969 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:12.246966 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.246937 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g"] Jul 27 16:59:12.249748 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:59:12.249720 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0e84c9a_6988_45f0_bf3a_646f281de5eb.slice/crio-92746fb05f398aa1528c7349b2d11f8faf0acc6d43fd375a11eccf57dfa2b432 WatchSource:0}: Error finding container 92746fb05f398aa1528c7349b2d11f8faf0acc6d43fd375a11eccf57dfa2b432: Status 404 returned error can't find the container with id 92746fb05f398aa1528c7349b2d11f8faf0acc6d43fd375a11eccf57dfa2b432 Jul 27 16:59:12.352388 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:12.352307 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" event={"ID":"b0e84c9a-6988-45f0-bf3a-646f281de5eb","Type":"ContainerStarted","Data":"92746fb05f398aa1528c7349b2d11f8faf0acc6d43fd375a11eccf57dfa2b432"} Jul 27 16:59:15.370161 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:15.370118 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" event={"ID":"b0e84c9a-6988-45f0-bf3a-646f281de5eb","Type":"ContainerStarted","Data":"9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be"} Jul 27 16:59:15.370573 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:15.370199 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:15.390430 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:15.390372 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" podStartSLOduration=2.003578001 podStartE2EDuration="4.390351929s" totalImagesPullingTime="2.386773928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:59:15.388336604 +0000 UTC m=+513.006041407" watchObservedRunningTime="2026-07-27 16:59:15.390351929 +0000 UTC m=+513.008056732" Jul 27 16:59:31.379908 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:31.379874 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 16:59:34.252781 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.252742 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vdfgw"] Jul 27 16:59:34.256259 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.256244 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" Jul 27 16:59:34.258313 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.258292 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-njzfb\"" Jul 27 16:59:34.264427 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.264405 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vdfgw"] Jul 27 16:59:34.285660 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.285633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66qpb\" (UniqueName: \"kubernetes.io/projected/391ed2a8-4017-4c81-8c66-87c3ac90b521-kube-api-access-66qpb\") pod \"test-trainjob-workflow-node-0-0-vdfgw\" (UID: \"391ed2a8-4017-4c81-8c66-87c3ac90b521\") " pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" Jul 27 16:59:34.386595 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.386559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66qpb\" (UniqueName: \"kubernetes.io/projected/391ed2a8-4017-4c81-8c66-87c3ac90b521-kube-api-access-66qpb\") pod \"test-trainjob-workflow-node-0-0-vdfgw\" (UID: \"391ed2a8-4017-4c81-8c66-87c3ac90b521\") " pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" Jul 27 16:59:34.395579 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.395551 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66qpb\" (UniqueName: \"kubernetes.io/projected/391ed2a8-4017-4c81-8c66-87c3ac90b521-kube-api-access-66qpb\") pod \"test-trainjob-workflow-node-0-0-vdfgw\" (UID: \"391ed2a8-4017-4c81-8c66-87c3ac90b521\") " pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" Jul 27 16:59:34.565470 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.565441 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" Jul 27 16:59:34.700518 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:34.700482 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vdfgw"] Jul 27 16:59:34.703580 ip-10-0-141-8 kubenswrapper[2582]: W0727 16:59:34.703552 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod391ed2a8_4017_4c81_8c66_87c3ac90b521.slice/crio-de64af77d8a8928a2d155378e9b512e49319f09e454fd85299f58335e70ac32f WatchSource:0}: Error finding container de64af77d8a8928a2d155378e9b512e49319f09e454fd85299f58335e70ac32f: Status 404 returned error can't find the container with id de64af77d8a8928a2d155378e9b512e49319f09e454fd85299f58335e70ac32f Jul 27 16:59:35.471464 ip-10-0-141-8 kubenswrapper[2582]: I0727 16:59:35.471346 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" event={"ID":"391ed2a8-4017-4c81-8c66-87c3ac90b521","Type":"ContainerStarted","Data":"de64af77d8a8928a2d155378e9b512e49319f09e454fd85299f58335e70ac32f"} Jul 27 17:00:45.472613 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:45.472588 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 17:00:45.473175 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:45.472587 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 17:00:46.880688 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:46.880648 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" event={"ID":"391ed2a8-4017-4c81-8c66-87c3ac90b521","Type":"ContainerStarted","Data":"078e58d41a1775e65ea9c1462220eb56be710fd0ff3afe219e5c1cbb615135ec"} Jul 27 17:00:46.899337 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:46.899275 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" podStartSLOduration=1.5983774720000001 podStartE2EDuration="1m12.899260312s" totalImagesPullingTime="1m11.30088284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:46.897526173 +0000 UTC m=+604.515230976" watchObservedRunningTime="2026-07-27 17:00:46.899260312 +0000 UTC m=+604.516965114" Jul 27 17:00:48.893271 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:48.893236 2582 generic.go:356] "Generic (PLEG): container finished" podID="391ed2a8-4017-4c81-8c66-87c3ac90b521" containerID="078e58d41a1775e65ea9c1462220eb56be710fd0ff3afe219e5c1cbb615135ec" exitCode=0 Jul 27 17:00:48.893667 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:48.893301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" event={"ID":"391ed2a8-4017-4c81-8c66-87c3ac90b521","Type":"ContainerDied","Data":"078e58d41a1775e65ea9c1462220eb56be710fd0ff3afe219e5c1cbb615135ec"} Jul 27 17:00:50.075185 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:50.075146 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" Jul 27 17:00:50.179839 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:50.179731 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66qpb\" (UniqueName: \"kubernetes.io/projected/391ed2a8-4017-4c81-8c66-87c3ac90b521-kube-api-access-66qpb\") pod \"391ed2a8-4017-4c81-8c66-87c3ac90b521\" (UID: \"391ed2a8-4017-4c81-8c66-87c3ac90b521\") " Jul 27 17:00:50.182062 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:50.182039 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391ed2a8-4017-4c81-8c66-87c3ac90b521-kube-api-access-66qpb" (OuterVolumeSpecName: "kube-api-access-66qpb") pod "391ed2a8-4017-4c81-8c66-87c3ac90b521" (UID: "391ed2a8-4017-4c81-8c66-87c3ac90b521"). InnerVolumeSpecName "kube-api-access-66qpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:00:50.281089 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:50.281048 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66qpb\" (UniqueName: \"kubernetes.io/projected/391ed2a8-4017-4c81-8c66-87c3ac90b521-kube-api-access-66qpb\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:00:50.909543 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:50.909515 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" Jul 27 17:00:50.909543 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:50.909523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vdfgw" event={"ID":"391ed2a8-4017-4c81-8c66-87c3ac90b521","Type":"ContainerDied","Data":"de64af77d8a8928a2d155378e9b512e49319f09e454fd85299f58335e70ac32f"} Jul 27 17:00:50.909758 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:50.909557 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de64af77d8a8928a2d155378e9b512e49319f09e454fd85299f58335e70ac32f" Jul 27 17:00:51.576842 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:51.576785 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vdfgw"] Jul 27 17:00:51.581859 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:51.581833 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vdfgw"] Jul 27 17:00:51.757607 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:51.757570 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g"] Jul 27 17:00:51.757782 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:51.757757 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" podUID="b0e84c9a-6988-45f0-bf3a-646f281de5eb" containerName="manager" containerID="cri-o://9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be" gracePeriod=30 Jul 27 17:00:52.545521 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.545495 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 17:00:52.601441 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.601406 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0e84c9a-6988-45f0-bf3a-646f281de5eb-cert\") pod \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " Jul 27 17:00:52.601919 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.601483 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t686v\" (UniqueName: \"kubernetes.io/projected/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kube-api-access-t686v\") pod \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " Jul 27 17:00:52.601919 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.601536 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kubeflow-trainer-config\") pod \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\" (UID: \"b0e84c9a-6988-45f0-bf3a-646f281de5eb\") " Jul 27 17:00:52.603594 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.603562 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kube-api-access-t686v" (OuterVolumeSpecName: "kube-api-access-t686v") pod "b0e84c9a-6988-45f0-bf3a-646f281de5eb" (UID: "b0e84c9a-6988-45f0-bf3a-646f281de5eb"). InnerVolumeSpecName "kube-api-access-t686v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:00:52.604039 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.604023 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e84c9a-6988-45f0-bf3a-646f281de5eb-cert" (OuterVolumeSpecName: "cert") pod "b0e84c9a-6988-45f0-bf3a-646f281de5eb" (UID: "b0e84c9a-6988-45f0-bf3a-646f281de5eb"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:00:52.606933 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.606909 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "b0e84c9a-6988-45f0-bf3a-646f281de5eb" (UID: "b0e84c9a-6988-45f0-bf3a-646f281de5eb"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:00:52.702412 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.702332 2582 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kubeflow-trainer-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:00:52.702412 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.702362 2582 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0e84c9a-6988-45f0-bf3a-646f281de5eb-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:00:52.702412 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.702373 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t686v\" (UniqueName: \"kubernetes.io/projected/b0e84c9a-6988-45f0-bf3a-646f281de5eb-kube-api-access-t686v\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:00:52.918569 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.918529 2582 generic.go:356] "Generic (PLEG): container finished" podID="b0e84c9a-6988-45f0-bf3a-646f281de5eb" containerID="9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be" exitCode=0 Jul 27 17:00:52.918569 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.918563 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" Jul 27 17:00:52.918757 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.918616 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" event={"ID":"b0e84c9a-6988-45f0-bf3a-646f281de5eb","Type":"ContainerDied","Data":"9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be"} Jul 27 17:00:52.918757 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.918656 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g" event={"ID":"b0e84c9a-6988-45f0-bf3a-646f281de5eb","Type":"ContainerDied","Data":"92746fb05f398aa1528c7349b2d11f8faf0acc6d43fd375a11eccf57dfa2b432"} Jul 27 17:00:52.918757 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.918675 2582 scope.go:117] "RemoveContainer" containerID="9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be" Jul 27 17:00:52.928020 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.928000 2582 scope.go:117] "RemoveContainer" containerID="9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be" Jul 27 17:00:52.928291 ip-10-0-141-8 kubenswrapper[2582]: E0727 17:00:52.928268 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be\": container with ID starting with 9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be not found: ID does not exist" containerID="9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be" Jul 27 17:00:52.928370 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.928298 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be"} err="failed to get container status \"9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be\": rpc error: code = NotFound desc = could not find container \"9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be\": container with ID starting with 9872126f77ede8bb6c9f4a8ebfab109405f564ad1c6c5eb6acc11d1292ae84be not found: ID does not exist" Jul 27 17:00:52.940958 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.940935 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g"] Jul 27 17:00:52.946357 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:52.946335 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-zjf7g"] Jul 27 17:00:53.030158 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:53.030072 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="391ed2a8-4017-4c81-8c66-87c3ac90b521" path="/var/lib/kubelet/pods/391ed2a8-4017-4c81-8c66-87c3ac90b521/volumes" Jul 27 17:00:53.030628 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:53.030603 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e84c9a-6988-45f0-bf3a-646f281de5eb" path="/var/lib/kubelet/pods/b0e84c9a-6988-45f0-bf3a-646f281de5eb/volumes" Jul 27 17:00:57.613861 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.613802 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9"] Jul 27 17:00:57.614253 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.614180 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391ed2a8-4017-4c81-8c66-87c3ac90b521" containerName="node" Jul 27 17:00:57.614253 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.614192 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="391ed2a8-4017-4c81-8c66-87c3ac90b521" containerName="node" Jul 27 17:00:57.614253 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.614216 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e84c9a-6988-45f0-bf3a-646f281de5eb" containerName="manager" Jul 27 17:00:57.614253 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.614222 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e84c9a-6988-45f0-bf3a-646f281de5eb" containerName="manager" Jul 27 17:00:57.614405 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.614288 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e84c9a-6988-45f0-bf3a-646f281de5eb" containerName="manager" Jul 27 17:00:57.614405 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.614298 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="391ed2a8-4017-4c81-8c66-87c3ac90b521" containerName="node" Jul 27 17:00:57.618375 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.618358 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.621406 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.621383 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-n7j6m\"" Jul 27 17:00:57.621406 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.621399 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 27 17:00:57.621564 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.621406 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 27 17:00:57.621564 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.621423 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.621564 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.621383 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.630052 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.630032 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9"] Jul 27 17:00:57.745882 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.745848 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.746053 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.745897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ctv\" (UniqueName: \"kubernetes.io/projected/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kube-api-access-m5ctv\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.746053 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.745935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d669b7c7-fd6f-4718-a750-cc5fb19e8478-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.847139 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.847097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d669b7c7-fd6f-4718-a750-cc5fb19e8478-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.847331 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.847201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.847331 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.847241 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ctv\" (UniqueName: \"kubernetes.io/projected/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kube-api-access-m5ctv\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.847937 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.847910 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.849649 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.849628 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d669b7c7-fd6f-4718-a750-cc5fb19e8478-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.856034 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.856010 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ctv\" (UniqueName: \"kubernetes.io/projected/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kube-api-access-m5ctv\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:57.927278 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:57.927186 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:58.058300 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:58.058274 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9"] Jul 27 17:00:58.060362 ip-10-0-141-8 kubenswrapper[2582]: W0727 17:00:58.060335 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd669b7c7_fd6f_4718_a750_cc5fb19e8478.slice/crio-a77a11a61e4542e6066ee84e8c4680402d8fb5905e6bb771b422400ed06dc281 WatchSource:0}: Error finding container a77a11a61e4542e6066ee84e8c4680402d8fb5905e6bb771b422400ed06dc281: Status 404 returned error can't find the container with id a77a11a61e4542e6066ee84e8c4680402d8fb5905e6bb771b422400ed06dc281 Jul 27 17:00:58.948348 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:58.948315 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" event={"ID":"d669b7c7-fd6f-4718-a750-cc5fb19e8478","Type":"ContainerStarted","Data":"72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8"} Jul 27 17:00:58.948348 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:58.948353 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" event={"ID":"d669b7c7-fd6f-4718-a750-cc5fb19e8478","Type":"ContainerStarted","Data":"a77a11a61e4542e6066ee84e8c4680402d8fb5905e6bb771b422400ed06dc281"} Jul 27 17:00:58.948856 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:58.948378 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:00:58.965391 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:00:58.965334 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" podStartSLOduration=1.965314662 podStartE2EDuration="1.965314662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:58.964471041 +0000 UTC m=+616.582175847" watchObservedRunningTime="2026-07-27 17:00:58.965314662 +0000 UTC m=+616.583019464" Jul 27 17:01:08.601008 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:08.597107 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx"] Jul 27 17:01:08.601008 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:08.597421 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" podUID="25414aa6-0020-45d1-b0c7-c04b6c73acd7" containerName="manager" containerID="cri-o://5afef404626a2c5fbf5911db0084068dac4e2c5bde926f5e1db82a02bae9e393" gracePeriod=10 Jul 27 17:01:08.996117 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:08.996043 2582 generic.go:356] "Generic (PLEG): container finished" podID="25414aa6-0020-45d1-b0c7-c04b6c73acd7" containerID="5afef404626a2c5fbf5911db0084068dac4e2c5bde926f5e1db82a02bae9e393" exitCode=0 Jul 27 17:01:08.996251 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:08.996114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" event={"ID":"25414aa6-0020-45d1-b0c7-c04b6c73acd7","Type":"ContainerDied","Data":"5afef404626a2c5fbf5911db0084068dac4e2c5bde926f5e1db82a02bae9e393"} Jul 27 17:01:09.397984 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.397958 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 17:01:09.556576 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.556544 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwnnd\" (UniqueName: \"kubernetes.io/projected/25414aa6-0020-45d1-b0c7-c04b6c73acd7-kube-api-access-cwnnd\") pod \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " Jul 27 17:01:09.556770 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.556596 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-tmp\") pod \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " Jul 27 17:01:09.556770 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.556641 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-manifests-work\") pod \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\" (UID: \"25414aa6-0020-45d1-b0c7-c04b6c73acd7\") " Jul 27 17:01:09.556980 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.556954 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-tmp" (OuterVolumeSpecName: "tmp") pod "25414aa6-0020-45d1-b0c7-c04b6c73acd7" (UID: "25414aa6-0020-45d1-b0c7-c04b6c73acd7"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 17:01:09.558839 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.558798 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25414aa6-0020-45d1-b0c7-c04b6c73acd7-kube-api-access-cwnnd" (OuterVolumeSpecName: "kube-api-access-cwnnd") pod "25414aa6-0020-45d1-b0c7-c04b6c73acd7" (UID: "25414aa6-0020-45d1-b0c7-c04b6c73acd7"). InnerVolumeSpecName "kube-api-access-cwnnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:01:09.559919 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.559897 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-manifests-work" (OuterVolumeSpecName: "manifests-work") pod "25414aa6-0020-45d1-b0c7-c04b6c73acd7" (UID: "25414aa6-0020-45d1-b0c7-c04b6c73acd7"). InnerVolumeSpecName "manifests-work". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 17:01:09.658302 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.658268 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwnnd\" (UniqueName: \"kubernetes.io/projected/25414aa6-0020-45d1-b0c7-c04b6c73acd7-kube-api-access-cwnnd\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:01:09.658302 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.658297 2582 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-tmp\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:01:09.658302 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:09.658306 2582 reconciler_common.go:299] "Volume detached for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/25414aa6-0020-45d1-b0c7-c04b6c73acd7-manifests-work\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:01:10.001810 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:10.001729 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" Jul 27 17:01:10.001810 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:10.001762 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx" event={"ID":"25414aa6-0020-45d1-b0c7-c04b6c73acd7","Type":"ContainerDied","Data":"297c8708bc4f1a1c0ab6f366080ed1029cf5c419746a494d3af2c177135a27e0"} Jul 27 17:01:10.002014 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:10.001849 2582 scope.go:117] "RemoveContainer" containerID="5afef404626a2c5fbf5911db0084068dac4e2c5bde926f5e1db82a02bae9e393" Jul 27 17:01:10.028722 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:10.028693 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx"] Jul 27 17:01:10.034210 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:10.034187 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-6c4vx"] Jul 27 17:01:11.029464 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:11.029428 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25414aa6-0020-45d1-b0c7-c04b6c73acd7" path="/var/lib/kubelet/pods/25414aa6-0020-45d1-b0c7-c04b6c73acd7/volumes" Jul 27 17:01:14.958113 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:14.958081 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:01:18.054483 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.054449 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8vv4s"] Jul 27 17:01:18.054877 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.054752 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25414aa6-0020-45d1-b0c7-c04b6c73acd7" containerName="manager" Jul 27 17:01:18.054877 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.054763 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25414aa6-0020-45d1-b0c7-c04b6c73acd7" containerName="manager" Jul 27 17:01:18.054877 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.054848 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="25414aa6-0020-45d1-b0c7-c04b6c73acd7" containerName="manager" Jul 27 17:01:18.208282 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.208248 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8vv4s"] Jul 27 17:01:18.208440 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.208338 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" Jul 27 17:01:18.211235 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.211204 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-njzfb\"" Jul 27 17:01:18.226297 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.226267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx57l\" (UniqueName: \"kubernetes.io/projected/a49840ab-f329-45ee-a463-66d647ff9ade-kube-api-access-hx57l\") pod \"test-trainjob-workflow-node-0-0-8vv4s\" (UID: \"a49840ab-f329-45ee-a463-66d647ff9ade\") " pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" Jul 27 17:01:18.327432 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.327354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx57l\" (UniqueName: \"kubernetes.io/projected/a49840ab-f329-45ee-a463-66d647ff9ade-kube-api-access-hx57l\") pod \"test-trainjob-workflow-node-0-0-8vv4s\" (UID: \"a49840ab-f329-45ee-a463-66d647ff9ade\") " pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" Jul 27 17:01:18.336208 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.336178 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx57l\" (UniqueName: \"kubernetes.io/projected/a49840ab-f329-45ee-a463-66d647ff9ade-kube-api-access-hx57l\") pod \"test-trainjob-workflow-node-0-0-8vv4s\" (UID: \"a49840ab-f329-45ee-a463-66d647ff9ade\") " pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" Jul 27 17:01:18.517303 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.517268 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" Jul 27 17:01:18.665120 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:18.665095 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8vv4s"] Jul 27 17:01:18.667475 ip-10-0-141-8 kubenswrapper[2582]: W0727 17:01:18.667442 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda49840ab_f329_45ee_a463_66d647ff9ade.slice/crio-136c93e6bb9ce4b5f18e4a89b497b8c25bbb6a853eeb23b057de8d6e0dc47188 WatchSource:0}: Error finding container 136c93e6bb9ce4b5f18e4a89b497b8c25bbb6a853eeb23b057de8d6e0dc47188: Status 404 returned error can't find the container with id 136c93e6bb9ce4b5f18e4a89b497b8c25bbb6a853eeb23b057de8d6e0dc47188 Jul 27 17:01:19.050124 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:19.050034 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" event={"ID":"a49840ab-f329-45ee-a463-66d647ff9ade","Type":"ContainerStarted","Data":"f8099f35118b783e7d3731a2d8b883eb71baefd7442265c362f14158609cc035"} Jul 27 17:01:19.050124 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:19.050080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" event={"ID":"a49840ab-f329-45ee-a463-66d647ff9ade","Type":"ContainerStarted","Data":"136c93e6bb9ce4b5f18e4a89b497b8c25bbb6a853eeb23b057de8d6e0dc47188"} Jul 27 17:01:19.068368 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:19.068101 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" podStartSLOduration=1.068081385 podStartE2EDuration="1.068081385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:19.066225349 +0000 UTC m=+636.683930162" watchObservedRunningTime="2026-07-27 17:01:19.068081385 +0000 UTC m=+636.685786190" Jul 27 17:01:22.066456 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:22.066425 2582 generic.go:356] "Generic (PLEG): container finished" podID="a49840ab-f329-45ee-a463-66d647ff9ade" containerID="f8099f35118b783e7d3731a2d8b883eb71baefd7442265c362f14158609cc035" exitCode=0 Jul 27 17:01:22.066925 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:22.066497 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" event={"ID":"a49840ab-f329-45ee-a463-66d647ff9ade","Type":"ContainerDied","Data":"f8099f35118b783e7d3731a2d8b883eb71baefd7442265c362f14158609cc035"} Jul 27 17:01:23.196484 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:23.196462 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" Jul 27 17:01:23.271269 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:23.271231 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx57l\" (UniqueName: \"kubernetes.io/projected/a49840ab-f329-45ee-a463-66d647ff9ade-kube-api-access-hx57l\") pod \"a49840ab-f329-45ee-a463-66d647ff9ade\" (UID: \"a49840ab-f329-45ee-a463-66d647ff9ade\") " Jul 27 17:01:23.273266 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:23.273241 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49840ab-f329-45ee-a463-66d647ff9ade-kube-api-access-hx57l" (OuterVolumeSpecName: "kube-api-access-hx57l") pod "a49840ab-f329-45ee-a463-66d647ff9ade" (UID: "a49840ab-f329-45ee-a463-66d647ff9ade"). InnerVolumeSpecName "kube-api-access-hx57l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:01:23.372398 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:23.372310 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx57l\" (UniqueName: \"kubernetes.io/projected/a49840ab-f329-45ee-a463-66d647ff9ade-kube-api-access-hx57l\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:01:24.076413 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:24.076385 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" Jul 27 17:01:24.076661 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:24.076425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-8vv4s" event={"ID":"a49840ab-f329-45ee-a463-66d647ff9ade","Type":"ContainerDied","Data":"136c93e6bb9ce4b5f18e4a89b497b8c25bbb6a853eeb23b057de8d6e0dc47188"} Jul 27 17:01:24.076661 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:24.076464 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="136c93e6bb9ce4b5f18e4a89b497b8c25bbb6a853eeb23b057de8d6e0dc47188" Jul 27 17:01:25.013730 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.013691 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8vv4s"] Jul 27 17:01:25.018054 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.018024 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-8vv4s"] Jul 27 17:01:25.030051 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.030016 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49840ab-f329-45ee-a463-66d647ff9ade" path="/var/lib/kubelet/pods/a49840ab-f329-45ee-a463-66d647ff9ade/volumes" Jul 27 17:01:25.158286 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.158244 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9"] Jul 27 17:01:25.158505 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.158479 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" podUID="d669b7c7-fd6f-4718-a750-cc5fb19e8478" containerName="manager" containerID="cri-o://72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8" gracePeriod=30 Jul 27 17:01:25.420799 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.420777 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:01:25.490408 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.490376 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d669b7c7-fd6f-4718-a750-cc5fb19e8478-cert\") pod \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " Jul 27 17:01:25.490587 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.490430 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kubeflow-trainer-config\") pod \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " Jul 27 17:01:25.490587 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.490463 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5ctv\" (UniqueName: \"kubernetes.io/projected/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kube-api-access-m5ctv\") pod \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\" (UID: \"d669b7c7-fd6f-4718-a750-cc5fb19e8478\") " Jul 27 17:01:25.492437 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.492407 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d669b7c7-fd6f-4718-a750-cc5fb19e8478-cert" (OuterVolumeSpecName: "cert") pod "d669b7c7-fd6f-4718-a750-cc5fb19e8478" (UID: "d669b7c7-fd6f-4718-a750-cc5fb19e8478"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:01:25.492539 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.492430 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kube-api-access-m5ctv" (OuterVolumeSpecName: "kube-api-access-m5ctv") pod "d669b7c7-fd6f-4718-a750-cc5fb19e8478" (UID: "d669b7c7-fd6f-4718-a750-cc5fb19e8478"). InnerVolumeSpecName "kube-api-access-m5ctv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:01:25.494845 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.494806 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "d669b7c7-fd6f-4718-a750-cc5fb19e8478" (UID: "d669b7c7-fd6f-4718-a750-cc5fb19e8478"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:01:25.591462 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.591431 2582 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d669b7c7-fd6f-4718-a750-cc5fb19e8478-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:01:25.591462 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.591461 2582 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kubeflow-trainer-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:01:25.591656 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:25.591473 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5ctv\" (UniqueName: \"kubernetes.io/projected/d669b7c7-fd6f-4718-a750-cc5fb19e8478-kube-api-access-m5ctv\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:01:26.086892 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.086851 2582 generic.go:356] "Generic (PLEG): container finished" podID="d669b7c7-fd6f-4718-a750-cc5fb19e8478" containerID="72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8" exitCode=0 Jul 27 17:01:26.086892 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.086886 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" Jul 27 17:01:26.087373 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.086925 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" event={"ID":"d669b7c7-fd6f-4718-a750-cc5fb19e8478","Type":"ContainerDied","Data":"72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8"} Jul 27 17:01:26.087373 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.086971 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9" event={"ID":"d669b7c7-fd6f-4718-a750-cc5fb19e8478","Type":"ContainerDied","Data":"a77a11a61e4542e6066ee84e8c4680402d8fb5905e6bb771b422400ed06dc281"} Jul 27 17:01:26.087373 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.086987 2582 scope.go:117] "RemoveContainer" containerID="72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8" Jul 27 17:01:26.095517 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.095501 2582 scope.go:117] "RemoveContainer" containerID="72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8" Jul 27 17:01:26.095758 ip-10-0-141-8 kubenswrapper[2582]: E0727 17:01:26.095736 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8\": container with ID starting with 72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8 not found: ID does not exist" containerID="72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8" Jul 27 17:01:26.095810 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.095768 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8"} err="failed to get container status \"72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8\": rpc error: code = NotFound desc = could not find container \"72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8\": container with ID starting with 72d2af3e6f666a871793820cb47b2d57b371b45cfbf387fd47b552474bf891a8 not found: ID does not exist" Jul 27 17:01:26.108060 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.108035 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9"] Jul 27 17:01:26.114195 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.114173 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-jkmj9"] Jul 27 17:01:26.696805 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.696764 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m9d5m/must-gather-f2l95"] Jul 27 17:01:26.697182 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.697165 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49840ab-f329-45ee-a463-66d647ff9ade" containerName="node" Jul 27 17:01:26.697267 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.697185 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49840ab-f329-45ee-a463-66d647ff9ade" containerName="node" Jul 27 17:01:26.697267 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.697208 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d669b7c7-fd6f-4718-a750-cc5fb19e8478" containerName="manager" Jul 27 17:01:26.697267 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.697217 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d669b7c7-fd6f-4718-a750-cc5fb19e8478" containerName="manager" Jul 27 17:01:26.697423 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.697303 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d669b7c7-fd6f-4718-a750-cc5fb19e8478" containerName="manager" Jul 27 17:01:26.697423 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.697316 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49840ab-f329-45ee-a463-66d647ff9ade" containerName="node" Jul 27 17:01:26.699881 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.699861 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:26.702064 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.702043 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m9d5m\"/\"kube-root-ca.crt\"" Jul 27 17:01:26.702064 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.702055 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m9d5m\"/\"openshift-service-ca.crt\"" Jul 27 17:01:26.702703 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.702685 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m9d5m\"/\"default-dockercfg-hzb67\"" Jul 27 17:01:26.707797 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.707778 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m9d5m/must-gather-f2l95"] Jul 27 17:01:26.800477 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.800436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qss8\" (UniqueName: \"kubernetes.io/projected/df85f053-30fd-480c-93c3-108b72ea60b8-kube-api-access-6qss8\") pod \"must-gather-f2l95\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:26.800683 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.800498 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df85f053-30fd-480c-93c3-108b72ea60b8-must-gather-output\") pod \"must-gather-f2l95\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:26.901558 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.901519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qss8\" (UniqueName: \"kubernetes.io/projected/df85f053-30fd-480c-93c3-108b72ea60b8-kube-api-access-6qss8\") pod \"must-gather-f2l95\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:26.901731 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.901575 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df85f053-30fd-480c-93c3-108b72ea60b8-must-gather-output\") pod \"must-gather-f2l95\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:26.901973 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.901953 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df85f053-30fd-480c-93c3-108b72ea60b8-must-gather-output\") pod \"must-gather-f2l95\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:26.909965 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:26.909940 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qss8\" (UniqueName: \"kubernetes.io/projected/df85f053-30fd-480c-93c3-108b72ea60b8-kube-api-access-6qss8\") pod \"must-gather-f2l95\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:27.009144 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:27.009045 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:01:27.030099 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:27.030071 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d669b7c7-fd6f-4718-a750-cc5fb19e8478" path="/var/lib/kubelet/pods/d669b7c7-fd6f-4718-a750-cc5fb19e8478/volumes" Jul 27 17:01:27.138209 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:27.138183 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m9d5m/must-gather-f2l95"] Jul 27 17:01:27.140984 ip-10-0-141-8 kubenswrapper[2582]: W0727 17:01:27.140956 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf85f053_30fd_480c_93c3_108b72ea60b8.slice/crio-139c50a791748500e625f8717e76aac23b98eb09240b9b4e4feee2900adb4f45 WatchSource:0}: Error finding container 139c50a791748500e625f8717e76aac23b98eb09240b9b4e4feee2900adb4f45: Status 404 returned error can't find the container with id 139c50a791748500e625f8717e76aac23b98eb09240b9b4e4feee2900adb4f45 Jul 27 17:01:27.142784 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:27.142769 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 17:01:28.102737 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:28.102696 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m9d5m/must-gather-f2l95" event={"ID":"df85f053-30fd-480c-93c3-108b72ea60b8","Type":"ContainerStarted","Data":"139c50a791748500e625f8717e76aac23b98eb09240b9b4e4feee2900adb4f45"} Jul 27 17:01:34.139675 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:34.139640 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m9d5m/must-gather-f2l95" event={"ID":"df85f053-30fd-480c-93c3-108b72ea60b8","Type":"ContainerStarted","Data":"151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba"} Jul 27 17:01:34.140083 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:34.139687 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m9d5m/must-gather-f2l95" event={"ID":"df85f053-30fd-480c-93c3-108b72ea60b8","Type":"ContainerStarted","Data":"52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70"} Jul 27 17:01:34.157257 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:01:34.156863 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m9d5m/must-gather-f2l95" podStartSLOduration=2.175249501 podStartE2EDuration="8.15684201s" totalImagesPullingTime="5.981592509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:34.156037763 +0000 UTC m=+651.773742566" watchObservedRunningTime="2026-07-27 17:01:34.15684201 +0000 UTC m=+651.774546812" Jul 27 17:02:19.381585 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:19.381547 2582 generic.go:356] "Generic (PLEG): container finished" podID="df85f053-30fd-480c-93c3-108b72ea60b8" containerID="52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70" exitCode=0 Jul 27 17:02:19.382043 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:19.381620 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m9d5m/must-gather-f2l95" event={"ID":"df85f053-30fd-480c-93c3-108b72ea60b8","Type":"ContainerDied","Data":"52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70"} Jul 27 17:02:19.382043 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:19.381980 2582 scope.go:117] "RemoveContainer" containerID="52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70" Jul 27 17:02:19.574772 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:19.574736 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-m9d5m_must-gather-f2l95_df85f053-30fd-480c-93c3-108b72ea60b8/gather/0.log" Jul 27 17:02:23.441091 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:23.441060 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lz5dv_7aad7c5c-40cb-4533-8095-01c95334bf4f/global-pull-secret-syncer/0.log" Jul 27 17:02:23.601492 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:23.601460 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sgqp4_cfde1ed1-7432-442b-afb4-bac9db6017ef/konnectivity-agent/0.log" Jul 27 17:02:23.677278 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:23.677222 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-8.ec2.internal_5a9939c2d7b33472f9d99dd0a21c376b/haproxy/0.log" Jul 27 17:02:24.932553 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:24.932511 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-m9d5m/must-gather-f2l95"] Jul 27 17:02:24.933380 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:24.932743 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-m9d5m/must-gather-f2l95" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" containerName="copy" containerID="cri-o://151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba" gracePeriod=2 Jul 27 17:02:24.934393 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:24.934367 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-m9d5m/must-gather-f2l95"] Jul 27 17:02:24.934587 ip-10-0-141-8 kubenswrapper[2582]: E0727 17:02:24.934563 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-f2l95\" is forbidden: User \"system:node:ip-10-0-141-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-m9d5m\": no relationship found between node 'ip-10-0-141-8.ec2.internal' and this object" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:02:25.168101 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.168073 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-m9d5m_must-gather-f2l95_df85f053-30fd-480c-93c3-108b72ea60b8/copy/0.log" Jul 27 17:02:25.170345 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.170328 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:02:25.203874 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.203789 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df85f053-30fd-480c-93c3-108b72ea60b8-must-gather-output\") pod \"df85f053-30fd-480c-93c3-108b72ea60b8\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " Jul 27 17:02:25.203874 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.203861 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qss8\" (UniqueName: \"kubernetes.io/projected/df85f053-30fd-480c-93c3-108b72ea60b8-kube-api-access-6qss8\") pod \"df85f053-30fd-480c-93c3-108b72ea60b8\" (UID: \"df85f053-30fd-480c-93c3-108b72ea60b8\") " Jul 27 17:02:25.205065 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.205044 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df85f053-30fd-480c-93c3-108b72ea60b8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "df85f053-30fd-480c-93c3-108b72ea60b8" (UID: "df85f053-30fd-480c-93c3-108b72ea60b8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 17:02:25.205897 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.205876 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df85f053-30fd-480c-93c3-108b72ea60b8-kube-api-access-6qss8" (OuterVolumeSpecName: "kube-api-access-6qss8") pod "df85f053-30fd-480c-93c3-108b72ea60b8" (UID: "df85f053-30fd-480c-93c3-108b72ea60b8"). InnerVolumeSpecName "kube-api-access-6qss8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:02:25.304498 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.304465 2582 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df85f053-30fd-480c-93c3-108b72ea60b8-must-gather-output\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:02:25.304498 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.304493 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qss8\" (UniqueName: \"kubernetes.io/projected/df85f053-30fd-480c-93c3-108b72ea60b8-kube-api-access-6qss8\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\"" Jul 27 17:02:25.410968 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.410938 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-m9d5m_must-gather-f2l95_df85f053-30fd-480c-93c3-108b72ea60b8/copy/0.log" Jul 27 17:02:25.411346 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.411319 2582 generic.go:356] "Generic (PLEG): container finished" podID="df85f053-30fd-480c-93c3-108b72ea60b8" containerID="151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba" exitCode=143 Jul 27 17:02:25.411437 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.411364 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m9d5m/must-gather-f2l95" Jul 27 17:02:25.411437 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.411424 2582 scope.go:117] "RemoveContainer" containerID="151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba" Jul 27 17:02:25.420251 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.420231 2582 scope.go:117] "RemoveContainer" containerID="52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70" Jul 27 17:02:25.431923 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.431902 2582 scope.go:117] "RemoveContainer" containerID="151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba" Jul 27 17:02:25.432242 ip-10-0-141-8 kubenswrapper[2582]: E0727 17:02:25.432219 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba\": container with ID starting with 151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba not found: ID does not exist" containerID="151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba" Jul 27 17:02:25.432290 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.432252 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba"} err="failed to get container status \"151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba\": rpc error: code = NotFound desc = could not find container \"151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba\": container with ID starting with 151125c79d94819cbbda6d82b776cc9b0816fe4b2ba9eb278f733f197d52b5ba not found: ID does not exist" Jul 27 17:02:25.432338 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.432271 2582 scope.go:117] "RemoveContainer" containerID="52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70" Jul 27 17:02:25.432561 ip-10-0-141-8 kubenswrapper[2582]: E0727 17:02:25.432541 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70\": container with ID starting with 52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70 not found: ID does not exist" containerID="52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70" Jul 27 17:02:25.432628 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:25.432567 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70"} err="failed to get container status \"52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70\": rpc error: code = NotFound desc = could not find container \"52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70\": container with ID starting with 52c3ae4245dbdf3750c230cc3fee0a38fdb90892dcc8df3dba6f337fa7b03f70 not found: ID does not exist" Jul 27 17:02:27.029594 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.029559 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" path="/var/lib/kubelet/pods/df85f053-30fd-480c-93c3-108b72ea60b8/volumes" Jul 27 17:02:27.099365 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.099325 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-5bjp4_40adc67f-064a-4b8e-b633-426d01c27cb4/cluster-monitoring-operator/0.log" Jul 27 17:02:27.268234 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.268201 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84b67477df-ng6mj_75ae5fa0-7f66-4507-a47f-a5ff6877a18d/metrics-server/0.log" Jul 27 17:02:27.531195 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.531166 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r69c5_46bb9d73-33bd-40ac-8694-302299aa2a26/node-exporter/0.log" Jul 27 17:02:27.559267 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.559231 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r69c5_46bb9d73-33bd-40ac-8694-302299aa2a26/kube-rbac-proxy/0.log" Jul 27 17:02:27.585117 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.585089 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r69c5_46bb9d73-33bd-40ac-8694-302299aa2a26/init-textfile/0.log" Jul 27 17:02:27.618006 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.617977 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gv98s_642bd38e-7d71-4811-8913-15422048f8cb/kube-rbac-proxy-main/0.log" Jul 27 17:02:27.641237 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.641212 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gv98s_642bd38e-7d71-4811-8913-15422048f8cb/kube-rbac-proxy-self/0.log" Jul 27 17:02:27.665541 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:27.665515 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gv98s_642bd38e-7d71-4811-8913-15422048f8cb/openshift-state-metrics/0.log" Jul 27 17:02:28.125781 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:28.125739 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-764f5c4747-vc9lf_fd985531-b415-4c3e-af59-0f8892e3a6f3/thanos-query/0.log" Jul 27 17:02:28.152273 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:28.152246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-764f5c4747-vc9lf_fd985531-b415-4c3e-af59-0f8892e3a6f3/kube-rbac-proxy-web/0.log" Jul 27 17:02:28.176861 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:28.176835 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-764f5c4747-vc9lf_fd985531-b415-4c3e-af59-0f8892e3a6f3/kube-rbac-proxy/0.log" Jul 27 17:02:28.202361 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:28.202337 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-764f5c4747-vc9lf_fd985531-b415-4c3e-af59-0f8892e3a6f3/prom-label-proxy/0.log" Jul 27 17:02:28.227702 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:28.227674 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-764f5c4747-vc9lf_fd985531-b415-4c3e-af59-0f8892e3a6f3/kube-rbac-proxy-rules/0.log" Jul 27 17:02:28.251328 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:28.251286 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-764f5c4747-vc9lf_fd985531-b415-4c3e-af59-0f8892e3a6f3/kube-rbac-proxy-metrics/0.log" Jul 27 17:02:29.588509 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:29.588483 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-gpqhk_3180b606-4ae9-47cf-95a2-5886a3013e08/networking-console-plugin/0.log" Jul 27 17:02:30.069831 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.069775 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/1.log" Jul 27 17:02:30.077222 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.077195 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-64gq6_38702e26-d8ec-428d-ad54-5b4fc3a6b1f9/console-operator/2.log" Jul 27 17:02:30.877064 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.877026 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w"] Jul 27 17:02:30.877448 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.877386 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" containerName="gather" Jul 27 17:02:30.877448 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.877398 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" containerName="gather" Jul 27 17:02:30.877448 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.877414 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" containerName="copy" Jul 27 17:02:30.877448 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.877420 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" containerName="copy" Jul 27 17:02:30.877574 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.877479 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" containerName="gather" Jul 27 17:02:30.877574 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.877489 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="df85f053-30fd-480c-93c3-108b72ea60b8" containerName="copy" Jul 27 17:02:30.883233 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.883213 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:30.886335 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.886248 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ghnrl\"/\"default-dockercfg-zrf44\"" Jul 27 17:02:30.886335 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.886275 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ghnrl\"/\"kube-root-ca.crt\"" Jul 27 17:02:30.886575 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.886334 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ghnrl\"/\"openshift-service-ca.crt\"" Jul 27 17:02:30.888731 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.888706 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w"] Jul 27 17:02:30.948457 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.948414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d5s6\" (UniqueName: \"kubernetes.io/projected/a9695877-5f36-4b03-90b2-46dc04f83cc5-kube-api-access-9d5s6\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:30.948620 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.948476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-lib-modules\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:30.948620 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.948546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-proc\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:30.948724 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.948628 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-podres\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:30.948724 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:30.948664 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-sys\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050103 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-podres\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050103 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050106 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-sys\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050361 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d5s6\" (UniqueName: \"kubernetes.io/projected/a9695877-5f36-4b03-90b2-46dc04f83cc5-kube-api-access-9d5s6\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050361 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050280 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-podres\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050361 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050280 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-sys\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050522 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-lib-modules\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050602 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050588 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-proc\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050657 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050613 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-lib-modules\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.050711 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.050669 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9695877-5f36-4b03-90b2-46dc04f83cc5-proc\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.056719 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.056694 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-cp4jl_5e4e5c70-6a55-4c25-ab43-bbb16a01d7ec/volume-data-source-validator/0.log" Jul 27 17:02:31.059008 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.058986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d5s6\" (UniqueName: \"kubernetes.io/projected/a9695877-5f36-4b03-90b2-46dc04f83cc5-kube-api-access-9d5s6\") pod \"perf-node-gather-daemonset-m5l7w\" (UID: \"a9695877-5f36-4b03-90b2-46dc04f83cc5\") " pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.194577 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.194495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.326040 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.326013 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w"] Jul 27 17:02:31.329008 ip-10-0-141-8 kubenswrapper[2582]: W0727 17:02:31.328976 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9695877_5f36_4b03_90b2_46dc04f83cc5.slice/crio-eeb0c230f0bf518b248dbb96872e07b3d885970384e6053a63b254b713512bce WatchSource:0}: Error finding container eeb0c230f0bf518b248dbb96872e07b3d885970384e6053a63b254b713512bce: Status 404 returned error can't find the container with id eeb0c230f0bf518b248dbb96872e07b3d885970384e6053a63b254b713512bce Jul 27 17:02:31.440279 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.440248 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" event={"ID":"a9695877-5f36-4b03-90b2-46dc04f83cc5","Type":"ContainerStarted","Data":"0d2c1f4d00e88d8b5f7f6fc38ea24d46d8c65f5e48d784735a80a1b4ca3e7df2"} Jul 27 17:02:31.440451 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.440302 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" event={"ID":"a9695877-5f36-4b03-90b2-46dc04f83cc5","Type":"ContainerStarted","Data":"eeb0c230f0bf518b248dbb96872e07b3d885970384e6053a63b254b713512bce"} Jul 27 17:02:31.440451 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.440333 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:31.456094 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.455960 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" podStartSLOduration=1.455943741 podStartE2EDuration="1.455943741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:31.455294625 +0000 UTC m=+709.072999464" watchObservedRunningTime="2026-07-27 17:02:31.455943741 +0000 UTC m=+709.073648544" Jul 27 17:02:31.868977 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.868951 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4t58r_3d1281ba-006c-4921-a314-33cfecf282f3/dns/0.log" Jul 27 17:02:31.902555 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:31.902526 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4t58r_3d1281ba-006c-4921-a314-33cfecf282f3/kube-rbac-proxy/0.log" Jul 27 17:02:32.088276 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:32.088245 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whfns_2f97815a-35d9-470a-a9c9-1ee7af844642/dns-node-resolver/0.log" Jul 27 17:02:32.520172 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:32.520144 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hhqxq_4aa87403-1a29-4193-9948-c9805d93f3a8/node-ca/0.log" Jul 27 17:02:33.268393 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:33.268365 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-646b69665-d6chx_8a729f11-ce8d-4a21-ac4b-907484ec1d69/router/0.log" Jul 27 17:02:33.628901 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:33.628867 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l2t2p_002fff69-43cb-4b5f-974a-62723949be11/serve-healthcheck-canary/0.log" Jul 27 17:02:33.987978 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:33.987868 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hsfsj_0b45b08f-5c6e-4445-8745-646eb7af6e34/insights-operator/0.log" Jul 27 17:02:33.988158 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:33.988021 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hsfsj_0b45b08f-5c6e-4445-8745-646eb7af6e34/insights-operator/1.log" Jul 27 17:02:34.171991 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:34.171959 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwc6f_6c2284e8-1470-4602-9798-0c94bd335960/kube-rbac-proxy/0.log" Jul 27 17:02:34.194564 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:34.194536 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwc6f_6c2284e8-1470-4602-9798-0c94bd335960/exporter/0.log" Jul 27 17:02:34.216964 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:34.216918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwc6f_6c2284e8-1470-4602-9798-0c94bd335960/extractor/0.log" Jul 27 17:02:37.454296 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:37.454222 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ghnrl/perf-node-gather-daemonset-m5l7w" Jul 27 17:02:39.094769 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:39.094731 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-lr6gr_e9b70a84-813c-47b8-947d-1608b13ee1bb/migrator/0.log" Jul 27 17:02:39.122935 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:39.122906 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-lr6gr_e9b70a84-813c-47b8-947d-1608b13ee1bb/graceful-termination/0.log" Jul 27 17:02:39.456470 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:39.456433 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm_f71bdb77-5c80-44eb-be60-d16602467705/kube-storage-version-migrator-operator/1.log" Jul 27 17:02:39.458030 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:39.458007 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-szfhm_f71bdb77-5c80-44eb-be60-d16602467705/kube-storage-version-migrator-operator/0.log" Jul 27 17:02:40.478423 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:40.478399 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzzzp_60c6ae70-8209-4710-89ab-b4844f954466/kube-multus-additional-cni-plugins/0.log" Jul 27 17:02:40.506623 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:40.506546 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzzzp_60c6ae70-8209-4710-89ab-b4844f954466/egress-router-binary-copy/0.log" Jul 27 17:02:40.532484 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:40.532456 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzzzp_60c6ae70-8209-4710-89ab-b4844f954466/cni-plugins/0.log" Jul 27 17:02:40.560050 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:40.560024 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzzzp_60c6ae70-8209-4710-89ab-b4844f954466/bond-cni-plugin/0.log" Jul 27 17:02:40.582700 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:40.582674 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzzzp_60c6ae70-8209-4710-89ab-b4844f954466/routeoverride-cni/0.log" Jul 27 17:02:40.604596 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:40.604575 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzzzp_60c6ae70-8209-4710-89ab-b4844f954466/whereabouts-cni-bincopy/0.log" Jul 27 17:02:40.625518 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:40.625495 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzzzp_60c6ae70-8209-4710-89ab-b4844f954466/whereabouts-cni/0.log" Jul 27 17:02:41.042993 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:41.042960 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jl7pk_33972e58-fe51-4593-96fa-06b5e7b11b30/kube-multus/0.log" Jul 27 17:02:41.179929 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:41.179901 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sjrqj_8c0a30c1-ed92-447a-a426-427bdffa913b/network-metrics-daemon/0.log" Jul 27 17:02:41.199000 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:41.198971 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sjrqj_8c0a30c1-ed92-447a-a426-427bdffa913b/kube-rbac-proxy/0.log" Jul 27 17:02:42.453808 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.453782 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/ovn-controller/0.log" Jul 27 17:02:42.469650 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.469621 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/ovn-acl-logging/0.log" Jul 27 17:02:42.495625 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.495601 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/kube-rbac-proxy-node/0.log" Jul 27 17:02:42.517627 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.517602 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 17:02:42.537751 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.537719 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/northd/0.log" Jul 27 17:02:42.579498 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.579473 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/nbdb/0.log" Jul 27 17:02:42.631509 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.631482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/sbdb/0.log" Jul 27 17:02:42.693191 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:42.693161 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svr4j_63936cfb-9df8-40a1-86c6-9d08390b1e0e/ovnkube-controller/0.log" Jul 27 17:02:43.644375 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:43.644329 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-pk2x7_553dba1f-63e4-47d0-92b3-a7e7736bfc54/check-endpoints/0.log" Jul 27 17:02:43.720013 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:43.719984 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-spsdn_9d97b403-3995-4419-8c1e-be90f78de9b0/network-check-target-container/0.log" Jul 27 17:02:44.655377 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:44.655351 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lck79_388fa658-3a4d-49e6-b70e-2088f86f68ad/iptables-alerter/0.log" Jul 27 17:02:45.359124 ip-10-0-141-8 kubenswrapper[2582]: I0727 17:02:45.359092 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-g7654_4e7d0917-8d76-4bed-b352-3c2d0fde827a/tuned/0.log"