Jul 07 14:55:03.551549 ip-10-0-130-141 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 14:55:03.551561 ip-10-0-130-141 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 14:55:03.551568 ip-10-0-130-141 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 14:55:03.551780 ip-10-0-130-141 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 14:55:13.699454 ip-10-0-130-141 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 14:55:13.699471 ip-10-0-130-141 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0f2fff2e2ed14a17a75ba78d4bb88a92 -- Jul 07 14:56:51.161341 ip-10-0-130-141 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.607509 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612804 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612816 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612822 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612830 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612836 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612840 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612845 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:51.628101 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612849 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612854 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612858 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612862 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612867 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612872 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612876 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612880 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612885 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612888 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612900 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612904 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612911 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612916 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612920 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612924 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612928 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612932 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612936 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:51.707301 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612941 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:51.690491 ip-10-0-130-141 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612945 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612948 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612953 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612957 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612960 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612964 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612968 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612972 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612976 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612979 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612983 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612987 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612993 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.612997 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613000 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613004 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613009 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613013 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613017 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:51.715914 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613021 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613025 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613028 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613032 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613043 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613047 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613052 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613055 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613058 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613079 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613084 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613087 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613091 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613095 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613099 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613103 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613107 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613111 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613115 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613119 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:51.718485 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613123 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613126 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613130 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613133 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613139 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613143 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613146 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613150 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613154 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613158 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613162 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613166 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613170 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613174 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613178 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613182 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613186 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613190 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613194 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:51.732138 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613197 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613204 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613209 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613213 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613217 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613221 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613224 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613228 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613233 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613236 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613240 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613243 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613247 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.613251 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614373 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614382 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614387 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614391 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614395 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614398 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:51.737422 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614403 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614409 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614415 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614420 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614424 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614429 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614432 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614439 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614444 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614448 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614452 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614457 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614461 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614465 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614469 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614473 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614477 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614480 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:51.887607 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614484 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614488 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614492 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614496 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614499 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614503 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614507 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614511 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614515 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614518 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614522 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614526 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614530 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614534 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614537 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614542 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614546 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614550 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614555 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614559 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:51.888369 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614563 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614569 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614573 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614577 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614581 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614585 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614598 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614602 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614605 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614609 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614613 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614617 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614621 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614624 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614629 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614633 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614636 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614640 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614644 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614647 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:51.889790 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614651 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614655 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614659 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614662 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614666 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614670 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614673 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614678 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614683 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614687 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614691 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614695 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614699 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614702 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614706 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614710 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614714 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614717 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614721 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614735 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:51.891959 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614739 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614743 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614747 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614750 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614754 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614758 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614762 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614766 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614771 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614775 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614778 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614782 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614785 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614789 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.614793 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615436 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615444 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615448 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615453 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615457 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:51.892540 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615461 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615465 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615469 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615473 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615477 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615481 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615485 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615488 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615492 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615496 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615500 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615514 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615520 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615524 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615529 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615533 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615538 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615544 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:51.893112 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615549 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615554 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615558 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615562 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615566 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615571 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615575 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615578 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615582 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615586 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615589 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615593 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615597 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615600 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615604 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615607 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615611 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615616 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615620 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615624 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:51.893594 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615627 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615631 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615635 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615639 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615642 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615646 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615657 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615661 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615665 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615668 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615672 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615677 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615680 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615684 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615688 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615692 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615695 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615701 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615705 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615709 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:51.894358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615713 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615716 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615720 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615724 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615728 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615739 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615743 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615747 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615751 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615755 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615758 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615762 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615766 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615770 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615773 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615777 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615781 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615785 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615790 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615801 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:51.895052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615805 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615812 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615815 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615819 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615823 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615827 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615831 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615834 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615838 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615844 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615847 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615851 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615855 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615859 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615862 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.615866 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.615955 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.615965 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.615977 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.615984 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.615990 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:56:51.895776 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.615994 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.615999 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616005 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616009 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616014 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616019 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616023 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616028 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616031 2582 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616036 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616040 2582 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616052 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616059 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616084 2582 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616088 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616093 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616098 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616103 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616108 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616112 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616118 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616124 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616128 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616132 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:56:51.896451 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616137 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616142 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616146 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616152 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616156 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616161 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616165 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616169 2582 flags.go:64] FLAG: --enable-server="true" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616174 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616183 2582 flags.go:64] FLAG: --event-burst="100" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616188 2582 flags.go:64] FLAG: --event-qps="50" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616192 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616197 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616201 2582 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616206 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616211 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616215 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616219 2582 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616224 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616227 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616241 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616246 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616251 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616255 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616259 2582 flags.go:64] FLAG: --feature-gates="" Jul 07 14:56:51.911851 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616265 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616270 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616274 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616281 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616285 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616289 2582 flags.go:64] FLAG: --help="false" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616294 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-130-141.ec2.internal" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616299 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616303 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616308 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616313 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616318 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616322 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616327 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616331 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616335 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616340 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616344 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616349 2582 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616353 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616357 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616362 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616366 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616370 2582 flags.go:64] FLAG: --lock-file="" Jul 07 14:56:51.912543 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616374 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616379 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616383 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616393 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616405 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616409 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616413 2582 flags.go:64] FLAG: --logging-format="text" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616425 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616430 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616435 2582 flags.go:64] FLAG: --manifest-url="" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616439 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616447 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616451 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616457 2582 flags.go:64] FLAG: --max-pods="110" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616461 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616465 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616470 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616474 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616478 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616482 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616486 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616496 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616499 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616504 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:56:51.913150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616508 2582 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616513 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616521 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616525 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616529 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616533 2582 flags.go:64] FLAG: --port="10250" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616537 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616542 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-013d3d78e7b2876c2" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616546 2582 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616550 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616555 2582 flags.go:64] FLAG: --register-node="true" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616559 2582 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616566 2582 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616578 2582 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616583 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616588 2582 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616594 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616598 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616603 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616608 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616612 2582 flags.go:64] FLAG: --runonce="false" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616616 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616621 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616625 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616630 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:56:51.913741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616633 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616637 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616642 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616646 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616650 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616655 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616659 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616662 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616667 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616671 2582 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616675 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616683 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616688 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616692 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616701 2582 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616705 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616709 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616714 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616718 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616723 2582 flags.go:64] FLAG: --v="2" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616729 2582 flags.go:64] FLAG: --version="false" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616744 2582 flags.go:64] FLAG: --vmodule="" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616750 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.616755 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617027 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:51.914380 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617034 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617041 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617045 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617050 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617054 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617058 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617081 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617086 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617090 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617093 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617097 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617101 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617104 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617109 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617113 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617117 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617120 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617124 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617128 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617132 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:51.915014 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617136 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617140 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617143 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617147 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617150 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617154 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617160 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617164 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617169 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617180 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617184 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617188 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617192 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617198 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617201 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617206 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617209 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617213 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617217 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617221 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:51.915531 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617225 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617229 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617232 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617236 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617241 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617244 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617250 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617255 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617259 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617264 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617268 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617272 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617276 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617280 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617284 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617287 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617291 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617295 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617301 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:51.916060 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617304 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617308 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617312 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617323 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617328 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617332 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617340 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617346 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617349 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617353 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617358 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617362 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617366 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617369 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617373 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617377 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617381 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617385 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617388 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:51.916567 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617392 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617396 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617399 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617404 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617409 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617412 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617416 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617422 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617427 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617431 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617435 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617439 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617444 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617449 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617453 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617457 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617461 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617472 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617477 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:51.917051 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.617482 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.617490 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.628416 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.628431 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.629329 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.629354 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629451 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629458 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629464 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629468 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629476 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629481 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629485 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629490 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:51.917547 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629494 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629498 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629502 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629506 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629512 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629517 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629522 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629527 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629532 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629536 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629540 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629544 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629551 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629555 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629558 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629562 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629566 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629570 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629574 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629581 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:51.917915 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629584 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629588 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629592 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629596 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629600 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629604 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629607 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629612 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629616 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629620 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629623 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629627 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629631 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629635 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629638 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629642 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629646 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629650 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629655 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:51.918421 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629659 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629662 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629666 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629669 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629673 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629680 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629684 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629687 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629692 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629695 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629699 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629703 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629709 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629713 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629717 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629720 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629724 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629728 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629732 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629735 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:51.918885 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629740 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629744 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629748 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629753 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629758 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629762 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629767 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629771 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629775 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629779 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629783 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629787 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629792 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629796 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629800 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629804 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629807 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629813 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629817 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:51.919493 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629820 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629824 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629828 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629832 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629835 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629841 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629845 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629849 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629852 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629856 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629860 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629864 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.629868 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.629875 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630050 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:56:51.919958 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630057 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630078 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630083 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630088 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630092 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630096 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630101 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630105 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630109 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630113 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630117 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630122 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630127 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630131 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630134 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630138 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630144 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630148 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630152 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630156 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:56:51.920357 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630159 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630163 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630169 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630172 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630176 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630180 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630184 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630188 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630193 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630197 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630201 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630205 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630210 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630214 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630217 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630221 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630225 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630228 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630233 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630237 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:56:51.920861 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630241 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630245 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630248 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630252 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630257 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630261 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630265 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630269 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630275 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630278 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630282 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630286 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630289 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630293 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630298 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630301 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630305 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630309 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630313 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630318 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:56:51.921358 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630324 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630328 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630334 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630339 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630343 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630347 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630352 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630355 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630360 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630364 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630369 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630374 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630379 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630383 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630387 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630390 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630394 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630399 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630403 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:56:51.921859 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630406 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630413 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630417 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630421 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630425 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630429 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630433 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630438 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630443 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630447 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630451 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630455 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630459 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630463 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630467 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630471 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630474 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630478 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:56:51.922336 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:51.630482 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.630489 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.630622 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.633696 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.635120 2582 server.go:1019] "Starting client certificate rotation" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.635218 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.635253 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.637768 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.639421 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.651869 2582 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.653898 2582 log.go:25] "Validated CRI v1 image API" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.655524 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:56:51.922812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.658270 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e1cff99e-bd87-4b55-abc1-6aa66b7b884e:/dev/nvme0n1p3 e7bdc8cb-01bb-487c-8cd1-7046dc2309f3:/dev/nvme0n1p4] Jul 07 14:56:51.923196 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.658288 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:56:51.923231 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.669533 2582 manager.go:216] Machine: {Timestamp:2026-07-07 14:56:51.668460113 +0000 UTC m=+0.392361921 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105518 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d2ba4c0542c9ac89b69be3b69deac SystemUUID:ec2d2ba4-c054-2c9a-c89b-69be3b69deac BootID:0f2fff2e-2ed1-4a17-a75b-a78d4bb88a92 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:55:15:39:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:55:15:39:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:dc:41:08:3b:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:56:51.923231 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.669639 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:56:51.923231 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.669733 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:56:51.923231 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.672809 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:56:51.923231 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.672837 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:56:51.923231 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.673114 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:56:51.923231 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.673500 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.673513 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.673525 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.674099 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.675411 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.678112 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.678312 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.678351 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.678364 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.678385 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.678395 2582 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.678405 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.680562 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.680589 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.682976 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.684662 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.684688 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685809 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685828 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685837 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685845 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685858 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685867 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685879 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685888 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685897 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685906 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685918 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.685926 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.686677 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.686687 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.689609 2582 server.go:1268] "Started kubelet" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.689693 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.689805 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.689890 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.691436 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.691933 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.691972 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.692088 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:56:51.923469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.692758 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.695058 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.696633 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.696650 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.696804 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697179 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697250 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697260 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697356 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697366 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697900 2582 factory.go:153] Registering CRI-O factory Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697924 2582 factory.go:223] Registration of the crio container factory successfully Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697982 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697992 2582 factory.go:55] Registering systemd factory Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.697999 2582 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.698018 2582 factory.go:103] Registering Raw factory Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.698031 2582 manager.go:1196] Started watching for new ooms in manager Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.698501 2582 manager.go:349] Starting recovery of all containers Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.706163 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-141.ec2.internal.18c009c915537a7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-141.ec2.internal,UID:ip-10-0-130-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-141.ec2.internal,},FirstTimestamp:2026-07-07 14:56:51.689585279 +0000 UTC m=+0.413487088,LastTimestamp:2026-07-07 14:56:51.689585279 +0000 UTC m=+0.413487088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-141.ec2.internal,}" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.715366 2582 manager.go:354] Recovery completed Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.716041 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.716085 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.720229 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.721196 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j55gw" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.721983 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.722007 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.722017 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.722565 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.722574 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.722579 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.722588 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.723247 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:51.924462 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.723273 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.723286 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.723549 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-141.ec2.internal.18c009c91741feec default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-141.ec2.internal,UID:ip-10-0-130-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-141.ec2.internal,},FirstTimestamp:2026-07-07 14:56:51.721993964 +0000 UTC m=+0.445895773,LastTimestamp:2026-07-07 14:56:51.721993964 +0000 UTC m=+0.445895773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-141.ec2.internal,}" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.723898 2582 policy_none.go:49] "None policy: Start" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.723914 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.723926 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.725237 2582 policy_none.go:47] "Start" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.727169 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j55gw" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.762586 2582 manager.go:337] "Starting Device Plugin manager" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.762742 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.762755 2582 server.go:87] "Starting device plugin registration server" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.762952 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.762961 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.763076 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.763198 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.763212 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.763642 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.763687 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.863209 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.864032 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.864060 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.864084 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.864114 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-141.ec2.internal" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.873396 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-141.ec2.internal" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.873412 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-141.ec2.internal\": node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:51.925299 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.897486 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:51.982897 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.982867 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:56:51.984013 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.983992 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:56:51.984095 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.984047 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:56:51.984095 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.984085 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:56:51.984198 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.984128 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:56:51.987325 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:51.987306 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:51.998586 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:51.998546 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.084758 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.084731 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal"] Jul 07 14:56:52.084815 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.084797 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:52.086317 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.086303 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:52.086380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.086330 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:52.086380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.086340 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:52.087705 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.087694 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:52.087812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.087797 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.087842 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.087833 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:52.088479 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.088462 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:52.088546 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.088494 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:52.088546 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.088508 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:52.088546 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.088525 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:52.088546 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.088534 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:52.088655 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.088509 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:52.089635 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.089621 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.089670 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.089648 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:56:52.090374 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.090355 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:56:52.090374 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.090379 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:56:52.090503 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.090388 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:56:52.099109 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.099091 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.099181 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.099152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6245624462c264761e6bc0bdfd40a9df-config\") pod \"kube-apiserver-proxy-ip-10-0-130-141.ec2.internal\" (UID: \"6245624462c264761e6bc0bdfd40a9df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.099181 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.099171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b858ed709bf065b9b08e83e7da03d712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal\" (UID: \"b858ed709bf065b9b08e83e7da03d712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.099243 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.099186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b858ed709bf065b9b08e83e7da03d712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal\" (UID: \"b858ed709bf065b9b08e83e7da03d712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.118589 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.118571 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-141.ec2.internal\" not found" node="ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.122659 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.122644 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-141.ec2.internal\" not found" node="ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.199265 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.199248 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.199336 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.199284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b858ed709bf065b9b08e83e7da03d712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal\" (UID: \"b858ed709bf065b9b08e83e7da03d712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.199336 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.199311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b858ed709bf065b9b08e83e7da03d712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal\" (UID: \"b858ed709bf065b9b08e83e7da03d712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.199414 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.199363 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b858ed709bf065b9b08e83e7da03d712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal\" (UID: \"b858ed709bf065b9b08e83e7da03d712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.199414 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.199373 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b858ed709bf065b9b08e83e7da03d712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal\" (UID: \"b858ed709bf065b9b08e83e7da03d712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.199414 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.199378 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6245624462c264761e6bc0bdfd40a9df-config\") pod \"kube-apiserver-proxy-ip-10-0-130-141.ec2.internal\" (UID: \"6245624462c264761e6bc0bdfd40a9df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.199517 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.199419 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6245624462c264761e6bc0bdfd40a9df-config\") pod \"kube-apiserver-proxy-ip-10-0-130-141.ec2.internal\" (UID: \"6245624462c264761e6bc0bdfd40a9df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.299723 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.299669 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.400077 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.400036 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.424204 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.424185 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.426269 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.426253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.500887 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.500861 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.601328 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.601275 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.634882 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.634847 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:56:52.635301 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.634984 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:56:52.701350 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.701330 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.729160 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.729127 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:51:51 +0000 UTC" deadline="2028-01-15 20:44:15.664323084 +0000 UTC" Jul 07 14:56:52.729160 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.729154 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13373h47m22.935171696s" Jul 07 14:56:52.801754 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:52.801731 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-141.ec2.internal\" not found" Jul 07 14:56:52.873135 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.871974 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:52.898213 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.898194 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.911795 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.911769 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:56:52.913618 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.913599 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" Jul 07 14:56:52.932048 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.932026 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:56:52.952958 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:52.952939 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:53.073855 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:53.073820 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb858ed709bf065b9b08e83e7da03d712.slice/crio-cc6dc138bdf51a7dd3aa5631bfbfec3992d6b197ba63b06b7a147df7494e24b7 WatchSource:0}: Error finding container cc6dc138bdf51a7dd3aa5631bfbfec3992d6b197ba63b06b7a147df7494e24b7: Status 404 returned error can't find the container with id cc6dc138bdf51a7dd3aa5631bfbfec3992d6b197ba63b06b7a147df7494e24b7 Jul 07 14:56:53.074251 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:53.074227 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6245624462c264761e6bc0bdfd40a9df.slice/crio-0247f123854a04e68ff041aa27e8753aae0d13b7ea1acf3c755881fc141ae4a0 WatchSource:0}: Error finding container 0247f123854a04e68ff041aa27e8753aae0d13b7ea1acf3c755881fc141ae4a0: Status 404 returned error can't find the container with id 0247f123854a04e68ff041aa27e8753aae0d13b7ea1acf3c755881fc141ae4a0 Jul 07 14:56:53.079365 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.079348 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:56:53.455036 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.455006 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:53.638729 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.638679 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:56:53.679172 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.679146 2582 apiserver.go:52] "Watching apiserver" Jul 07 14:56:53.688454 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.688429 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:56:53.688934 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.688905 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-d27k9","openshift-dns/node-resolver-gdr2n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal","openshift-multus/network-metrics-daemon-jhpg5","openshift-network-diagnostics/network-check-target-q8n52","openshift-ovn-kubernetes/ovnkube-node-nq8wm","kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg","openshift-cluster-node-tuning-operator/tuned-7mm72","openshift-image-registry/node-ca-zzp9g","openshift-multus/multus-additional-cni-plugins-8szxz","openshift-multus/multus-xmlfj","openshift-network-operator/iptables-alerter-qwfgt","kube-system/global-pull-secret-syncer-mnjnx"] Jul 07 14:56:53.691707 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.691679 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.694127 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.694105 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.695211 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.694951 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:56:53.695211 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.694961 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:56:53.695211 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.695013 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zqzrl\"" Jul 07 14:56:53.695211 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.695150 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:56:53.696824 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.696801 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:56:53.697105 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.697074 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:56:53.698028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.698000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fsx5c\"" Jul 07 14:56:53.698028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.698016 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:56:53.698239 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.698192 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:56:53.698429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.698412 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.698947 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.698482 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:56:53.698947 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.698782 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:53.698947 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.698858 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:56:53.701445 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.701138 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:53.701445 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.701215 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:56:53.704215 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.703900 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.708396 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708298 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-host\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.708396 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-serviceca\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.708396 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdjwl\" (UniqueName: \"kubernetes.io/projected/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-kube-api-access-vdjwl\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.708598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-iptables-alerter-script\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.708598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gccf\" (UniqueName: \"kubernetes.io/projected/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-kube-api-access-4gccf\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.708598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-host-slash\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.708598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b611955-d7ce-493b-8d46-dcf31815c4bc-kubelet-config\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.708598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b611955-d7ce-493b-8d46-dcf31815c4bc-dbus\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.708598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708553 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.708598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708595 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:53.708954 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.708627 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xrnk\" (UniqueName: \"kubernetes.io/projected/b10826e0-c841-4537-a855-18fd4d6ba933-kube-api-access-2xrnk\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:53.709240 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.709219 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:56:53.709541 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.709521 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:56:53.715135 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.712364 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:56:53.715135 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.713025 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:56:53.715135 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.713522 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:56:53.715135 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.713752 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:56:53.715135 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.714028 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.715135 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.714815 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p4vxc\"" Jul 07 14:56:53.716575 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.716398 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.717517 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.717495 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:56:53.719427 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.719406 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.719689 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.719668 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:56:53.720450 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.720426 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:56:53.721311 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.720689 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6dnp4\"" Jul 07 14:56:53.721311 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.720885 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:56:53.721311 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.721072 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:56:53.721311 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.721108 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vt9mh\"" Jul 07 14:56:53.721311 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.721110 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:56:53.722415 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.722203 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:53.722415 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.722394 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-66psz\"" Jul 07 14:56:53.722744 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.722582 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:56:53.723133 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.723104 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:56:53.724629 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.724525 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.725324 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.725301 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:56:53.725510 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.725492 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:56:53.725734 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.725718 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zjjw9\"" Jul 07 14:56:53.727103 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.727074 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.727756 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.727616 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:56:53.727756 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.727632 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:56:53.727900 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.727875 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8hlck\"" Jul 07 14:56:53.728529 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.728142 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:56:53.728529 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.728223 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:56:53.728529 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.728383 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:56:53.730186 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.729708 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:56:53.730186 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.730039 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t6jjm\"" Jul 07 14:56:53.734559 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.734535 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-29gl2" Jul 07 14:56:53.743633 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.743607 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-29gl2" Jul 07 14:56:53.798369 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.798350 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:56:53.809556 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809531 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-iptables-alerter-script\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.809660 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809576 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-os-release\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.809660 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysctl-d\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.809660 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809628 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f4f10-4697-4922-a85b-db05334e39fa-cni-binary-copy\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.809660 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-netns\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.809869 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-serviceca\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.809869 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-kubelet\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.809869 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.809869 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809788 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-os-release\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.809869 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-etc-kubernetes\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.809869 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-run\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809904 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809934 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xrnk\" (UniqueName: \"kubernetes.io/projected/b10826e0-c841-4537-a855-18fd4d6ba933-kube-api-access-2xrnk\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-slash\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.809987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810013 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-cni-netd\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-kubelet\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810157 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-multus-certs\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.810189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-sys\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810214 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-etc-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810244 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-iptables-alerter-script\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810272 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-serviceca\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-sys-fs\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-systemd-units\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810370 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-socket-dir-parent\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.810396 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.810470 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret podName:2b611955-d7ce-493b-8d46-dcf31815c4bc nodeName:}" failed. No retries permitted until 2026-07-07 14:56:54.310437558 +0000 UTC m=+3.034339356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret") pod "global-pull-secret-syncer-mnjnx" (UID: "2b611955-d7ce-493b-8d46-dcf31815c4bc") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-daemon-config\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysctl-conf\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810530 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-lib-modules\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.810672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-host\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-tuned\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-socket-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-hostroot\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-device-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810838 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwv2z\" (UniqueName: \"kubernetes.io/projected/f3db4e78-b1b3-4eec-8a2a-b7073355e415-kube-api-access-xwv2z\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-tmp-dir\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810896 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-host-slash\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.810954 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-conf-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811008 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-host-slash\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811035 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-modprobe-d\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811064 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-kubernetes\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.811382 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-host\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-run-netns\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811155 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-host\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-system-cni-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811221 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-systemd\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811247 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn5tc\" (UniqueName: \"kubernetes.io/projected/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-kube-api-access-zn5tc\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811279 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-ovnkube-script-lib\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvm4c\" (UniqueName: \"kubernetes.io/projected/571df583-610b-4655-8dde-1c579bbbc2be-kube-api-access-gvm4c\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cnibin\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-systemd\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811383 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-ovnkube-config\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/571df583-610b-4655-8dde-1c579bbbc2be-ovn-node-metrics-cert\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7svq\" (UniqueName: \"kubernetes.io/projected/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-kube-api-access-n7svq\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.812097 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlrpm\" (UniqueName: \"kubernetes.io/projected/3b4f4f10-4697-4922-a85b-db05334e39fa-kube-api-access-zlrpm\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811485 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-var-lib-kubelet\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5pnt\" (UniqueName: \"kubernetes.io/projected/8133a451-bdd4-4bef-8a92-f3675f59cab0-kube-api-access-d5pnt\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811544 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-node-log\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b611955-d7ce-493b-8d46-dcf31815c4bc-dbus\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gccf\" (UniqueName: \"kubernetes.io/projected/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-kube-api-access-4gccf\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-var-lib-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-env-overrides\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-cni-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811732 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8133a451-bdd4-4bef-8a92-f3675f59cab0-tmp\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b611955-d7ce-493b-8d46-dcf31815c4bc-kubelet-config\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-cnibin\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811821 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-k8s-cni-cncf-io\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.812901 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-cni-multus\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-registration-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8801-c808-4e22-b18f-c73cb691cb11-konnectivity-ca\") pod \"konnectivity-agent-d27k9\" (UID: \"c64f8801-c808-4e22-b18f-c73cb691cb11\") " pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811918 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-ovn\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811943 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-log-socket\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811966 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-cni-bin\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.811992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812029 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdjwl\" (UniqueName: \"kubernetes.io/projected/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-kube-api-access-vdjwl\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-run-ovn-kubernetes\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-cni-bin\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812159 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysconfig\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812189 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-etc-selinux\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-hosts-file\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.813574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812236 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c64f8801-c808-4e22-b18f-c73cb691cb11-agent-certs\") pod \"konnectivity-agent-d27k9\" (UID: \"c64f8801-c808-4e22-b18f-c73cb691cb11\") " pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:53.814344 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812571 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b611955-d7ce-493b-8d46-dcf31815c4bc-dbus\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.814344 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.812655 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b611955-d7ce-493b-8d46-dcf31815c4bc-kubelet-config\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:53.814344 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.812756 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:53.814344 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.812803 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs podName:b10826e0-c841-4537-a855-18fd4d6ba933 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:54.31278724 +0000 UTC m=+3.036689043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs") pod "network-metrics-daemon-jhpg5" (UID: "b10826e0-c841-4537-a855-18fd4d6ba933") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:53.822521 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.822496 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:56:53.828386 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.828360 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xrnk\" (UniqueName: \"kubernetes.io/projected/b10826e0-c841-4537-a855-18fd4d6ba933-kube-api-access-2xrnk\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:53.831753 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.831607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gccf\" (UniqueName: \"kubernetes.io/projected/d6399bef-6d74-4bcc-b53d-41b4dc6e2d01-kube-api-access-4gccf\") pod \"iptables-alerter-qwfgt\" (UID: \"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01\") " pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:53.831753 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.831709 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdjwl\" (UniqueName: \"kubernetes.io/projected/5df3e50e-b9a9-4128-9af0-13c3c94d04c6-kube-api-access-vdjwl\") pod \"node-ca-zzp9g\" (UID: \"5df3e50e-b9a9-4128-9af0-13c3c94d04c6\") " pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f4f10-4697-4922-a85b-db05334e39fa-cni-binary-copy\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-netns\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-kubelet\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912863 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-os-release\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-etc-kubernetes\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912913 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-run\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-slash\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.912978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-cni-netd\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913028 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-kubelet\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-multus-certs\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913076 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-sys\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913100 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-etc-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.916207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-sys-fs\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-systemd-units\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-socket-dir-parent\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913270 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-daemon-config\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysctl-conf\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-lib-modules\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-host\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-tuned\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-socket-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913481 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-hostroot\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.917054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-device-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913536 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwv2z\" (UniqueName: \"kubernetes.io/projected/f3db4e78-b1b3-4eec-8a2a-b7073355e415-kube-api-access-xwv2z\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913560 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-tmp-dir\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913586 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-conf-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-modprobe-d\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913615 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913649 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-kubernetes\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-run-netns\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-system-cni-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-systemd\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn5tc\" (UniqueName: \"kubernetes.io/projected/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-kube-api-access-zn5tc\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-ovnkube-script-lib\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913894 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvm4c\" (UniqueName: \"kubernetes.io/projected/571df583-610b-4655-8dde-1c579bbbc2be-kube-api-access-gvm4c\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.917799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913920 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cnibin\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913947 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-systemd\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.913972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-ovnkube-config\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/571df583-610b-4655-8dde-1c579bbbc2be-ovn-node-metrics-cert\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7svq\" (UniqueName: \"kubernetes.io/projected/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-kube-api-access-n7svq\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlrpm\" (UniqueName: \"kubernetes.io/projected/3b4f4f10-4697-4922-a85b-db05334e39fa-kube-api-access-zlrpm\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-var-lib-kubelet\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5pnt\" (UniqueName: \"kubernetes.io/projected/8133a451-bdd4-4bef-8a92-f3675f59cab0-kube-api-access-d5pnt\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-node-log\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914244 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-var-lib-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914243 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b4f4f10-4697-4922-a85b-db05334e39fa-cni-binary-copy\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914292 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-netns\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914324 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.918592 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914369 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-kubelet\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914413 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914478 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-multus-certs\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914476 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-run-netns\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914493 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-kubelet\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914514 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914542 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-cni-netd\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914562 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-etc-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914586 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-os-release\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914605 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-sys-fs\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914614 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-run\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914637 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-sys\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914650 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-systemd-units\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914660 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-etc-kubernetes\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914685 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-slash\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.919398 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914746 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-env-overrides\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914757 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-device-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914923 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-system-cni-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914948 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-var-lib-kubelet\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915003 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-systemd\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915038 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cnibin\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915077 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-tmp-dir\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915091 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-systemd\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915168 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-node-log\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.914326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-env-overrides\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915272 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-cni-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915276 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-var-lib-openvswitch\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8133a451-bdd4-4bef-8a92-f3675f59cab0-tmp\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915304 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915315 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-ovnkube-script-lib\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920207 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-cnibin\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915346 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-conf-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915347 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-hostroot\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915304 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-k8s-cni-cncf-io\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915404 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-socket-dir-parent\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915425 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-modprobe-d\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-cni-multus\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-registration-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915453 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915407 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-run-k8s-cni-cncf-io\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8801-c808-4e22-b18f-c73cb691cb11-konnectivity-ca\") pod \"konnectivity-agent-d27k9\" (UID: \"c64f8801-c808-4e22-b18f-c73cb691cb11\") " pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-ovn\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915528 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-log-socket\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-cni-bin\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.920987 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915559 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-lib-modules\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915608 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-cni-bin\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915611 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-kubernetes\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915655 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-registration-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915447 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-cni-multus\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915684 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-run-ovn-kubernetes\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915744 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-cni-bin\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysconfig\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915793 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysctl-conf\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-etc-selinux\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-hosts-file\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c64f8801-c808-4e22-b18f-c73cb691cb11-agent-certs\") pod \"konnectivity-agent-d27k9\" (UID: \"c64f8801-c808-4e22-b18f-c73cb691cb11\") " pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915875 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-etc-selinux\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.921820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-os-release\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysctl-d\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915924 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-daemon-config\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915958 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-host-var-lib-cni-bin\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915982 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/571df583-610b-4655-8dde-1c579bbbc2be-ovnkube-config\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915993 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysconfig\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915988 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-log-socket\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916027 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-hosts-file\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916043 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-os-release\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916051 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-sysctl-d\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.915928 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-host-run-ovn-kubernetes\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916096 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-cnibin\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916108 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b4f4f10-4697-4922-a85b-db05334e39fa-multus-cni-dir\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916105 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3db4e78-b1b3-4eec-8a2a-b7073355e415-socket-dir\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916167 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/571df583-610b-4655-8dde-1c579bbbc2be-run-ovn\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.922589 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916200 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8133a451-bdd4-4bef-8a92-f3675f59cab0-host\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.923416 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916624 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c64f8801-c808-4e22-b18f-c73cb691cb11-konnectivity-ca\") pod \"konnectivity-agent-d27k9\" (UID: \"c64f8801-c808-4e22-b18f-c73cb691cb11\") " pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:53.923416 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.916634 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.923416 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.921738 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8133a451-bdd4-4bef-8a92-f3675f59cab0-etc-tuned\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.923416 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.922013 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/571df583-610b-4655-8dde-1c579bbbc2be-ovn-node-metrics-cert\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.925815 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.923860 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8133a451-bdd4-4bef-8a92-f3675f59cab0-tmp\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.925815 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.924434 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c64f8801-c808-4e22-b18f-c73cb691cb11-agent-certs\") pod \"konnectivity-agent-d27k9\" (UID: \"c64f8801-c808-4e22-b18f-c73cb691cb11\") " pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:53.925815 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.925183 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:56:53.925815 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.925206 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:56:53.925815 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.925219 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nvj84 for pod openshift-network-diagnostics/network-check-target-q8n52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:53.925815 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:53.925280 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84 podName:596f38b8-78a0-4915-bf9f-f8caed7e4238 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:54.425263404 +0000 UTC m=+3.149165202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nvj84" (UniqueName: "kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84") pod "network-check-target-q8n52" (UID: "596f38b8-78a0-4915-bf9f-f8caed7e4238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:53.927095 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.927068 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwv2z\" (UniqueName: \"kubernetes.io/projected/f3db4e78-b1b3-4eec-8a2a-b7073355e415-kube-api-access-xwv2z\") pod \"aws-ebs-csi-driver-node-x49dg\" (UID: \"f3db4e78-b1b3-4eec-8a2a-b7073355e415\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:53.929052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.929025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn5tc\" (UniqueName: \"kubernetes.io/projected/0d6cd7f9-5d3e-4942-ba66-6718a04797ed-kube-api-access-zn5tc\") pod \"node-resolver-gdr2n\" (UID: \"0d6cd7f9-5d3e-4942-ba66-6718a04797ed\") " pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:53.929155 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.929117 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvm4c\" (UniqueName: \"kubernetes.io/projected/571df583-610b-4655-8dde-1c579bbbc2be-kube-api-access-gvm4c\") pod \"ovnkube-node-nq8wm\" (UID: \"571df583-610b-4655-8dde-1c579bbbc2be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:53.931260 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.931217 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlrpm\" (UniqueName: \"kubernetes.io/projected/3b4f4f10-4697-4922-a85b-db05334e39fa-kube-api-access-zlrpm\") pod \"multus-xmlfj\" (UID: \"3b4f4f10-4697-4922-a85b-db05334e39fa\") " pod="openshift-multus/multus-xmlfj" Jul 07 14:56:53.931501 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.931477 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7svq\" (UniqueName: \"kubernetes.io/projected/4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e-kube-api-access-n7svq\") pod \"multus-additional-cni-plugins-8szxz\" (UID: \"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e\") " pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:53.933665 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.933622 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5pnt\" (UniqueName: \"kubernetes.io/projected/8133a451-bdd4-4bef-8a92-f3675f59cab0-kube-api-access-d5pnt\") pod \"tuned-7mm72\" (UID: \"8133a451-bdd4-4bef-8a92-f3675f59cab0\") " pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:53.990274 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.990182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" event={"ID":"b858ed709bf065b9b08e83e7da03d712","Type":"ContainerStarted","Data":"cc6dc138bdf51a7dd3aa5631bfbfec3992d6b197ba63b06b7a147df7494e24b7"} Jul 07 14:56:53.991790 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:53.991758 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" event={"ID":"6245624462c264761e6bc0bdfd40a9df","Type":"ContainerStarted","Data":"0247f123854a04e68ff041aa27e8753aae0d13b7ea1acf3c755881fc141ae4a0"} Jul 07 14:56:54.012373 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.012348 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zzp9g" Jul 07 14:56:54.023565 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:54.023535 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df3e50e_b9a9_4128_9af0_13c3c94d04c6.slice/crio-ab2694b7346223416cd0480ad8c590230cb40cba5ee693624709cc5b46058d76 WatchSource:0}: Error finding container ab2694b7346223416cd0480ad8c590230cb40cba5ee693624709cc5b46058d76: Status 404 returned error can't find the container with id ab2694b7346223416cd0480ad8c590230cb40cba5ee693624709cc5b46058d76 Jul 07 14:56:54.025587 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.025565 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwfgt" Jul 07 14:56:54.034847 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.034816 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:56:54.042899 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.042880 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7mm72" Jul 07 14:56:54.051650 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.051632 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" Jul 07 14:56:54.061385 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.061363 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gdr2n" Jul 07 14:56:54.072324 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.072306 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:56:54.079301 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.079280 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8szxz" Jul 07 14:56:54.087056 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.087040 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xmlfj" Jul 07 14:56:54.318972 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.318885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:54.318972 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.318961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:54.319230 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.319051 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:54.319230 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.319059 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:54.319230 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.319129 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs podName:b10826e0-c841-4537-a855-18fd4d6ba933 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:55.319091864 +0000 UTC m=+4.042993660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs") pod "network-metrics-daemon-jhpg5" (UID: "b10826e0-c841-4537-a855-18fd4d6ba933") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:54.319230 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.319149 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret podName:2b611955-d7ce-493b-8d46-dcf31815c4bc nodeName:}" failed. No retries permitted until 2026-07-07 14:56:55.319138897 +0000 UTC m=+4.043040714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret") pod "global-pull-secret-syncer-mnjnx" (UID: "2b611955-d7ce-493b-8d46-dcf31815c4bc") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:54.380667 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:54.380633 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6399bef_6d74_4bcc_b53d_41b4dc6e2d01.slice/crio-2ee49dbdeb8476464b1284c986de3e10e1ee9c43d62923d985076d593895450b WatchSource:0}: Error finding container 2ee49dbdeb8476464b1284c986de3e10e1ee9c43d62923d985076d593895450b: Status 404 returned error can't find the container with id 2ee49dbdeb8476464b1284c986de3e10e1ee9c43d62923d985076d593895450b Jul 07 14:56:54.520664 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.520629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:54.520860 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.520776 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:56:54.520860 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.520799 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:56:54.520860 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.520808 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nvj84 for pod openshift-network-diagnostics/network-check-target-q8n52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:54.521022 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.520869 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84 podName:596f38b8-78a0-4915-bf9f-f8caed7e4238 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:55.520850533 +0000 UTC m=+4.244752331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvj84" (UniqueName: "kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84") pod "network-check-target-q8n52" (UID: "596f38b8-78a0-4915-bf9f-f8caed7e4238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:54.747502 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.747418 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:51:53 +0000 UTC" deadline="2028-04-20 07:43:46.47792839 +0000 UTC" Jul 07 14:56:54.747502 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.747463 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15664h46m51.730467768s" Jul 07 14:56:54.984804 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.984777 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:54.984987 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:54.984894 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:56:54.994636 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.994595 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwfgt" event={"ID":"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01","Type":"ContainerStarted","Data":"2ee49dbdeb8476464b1284c986de3e10e1ee9c43d62923d985076d593895450b"} Jul 07 14:56:54.995747 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:54.995714 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zzp9g" event={"ID":"5df3e50e-b9a9-4128-9af0-13c3c94d04c6","Type":"ContainerStarted","Data":"ab2694b7346223416cd0480ad8c590230cb40cba5ee693624709cc5b46058d76"} Jul 07 14:56:55.093120 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:55.093081 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571df583_610b_4655_8dde_1c579bbbc2be.slice/crio-d96744341a326e9882c5474bdd638287c48bb09b6c446c4587765590fc9dd75b WatchSource:0}: Error finding container d96744341a326e9882c5474bdd638287c48bb09b6c446c4587765590fc9dd75b: Status 404 returned error can't find the container with id d96744341a326e9882c5474bdd638287c48bb09b6c446c4587765590fc9dd75b Jul 07 14:56:55.094250 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:55.094226 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8133a451_bdd4_4bef_8a92_f3675f59cab0.slice/crio-47d572588332668ac6d2dcbd6153404d3a0b47016afc85e6e3dd44a7c1d4a066 WatchSource:0}: Error finding container 47d572588332668ac6d2dcbd6153404d3a0b47016afc85e6e3dd44a7c1d4a066: Status 404 returned error can't find the container with id 47d572588332668ac6d2dcbd6153404d3a0b47016afc85e6e3dd44a7c1d4a066 Jul 07 14:56:55.095574 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:55.095468 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4f4f10_4697_4922_a85b_db05334e39fa.slice/crio-6e64cef58a50a8a79d003fd5d7cc14a1cfeaa48c55ae261177551e6645bb6fcc WatchSource:0}: Error finding container 6e64cef58a50a8a79d003fd5d7cc14a1cfeaa48c55ae261177551e6645bb6fcc: Status 404 returned error can't find the container with id 6e64cef58a50a8a79d003fd5d7cc14a1cfeaa48c55ae261177551e6645bb6fcc Jul 07 14:56:55.099222 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:55.099202 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9e2e49_9db9_4ddd_b22a_7b41a5505a6e.slice/crio-7e6015920a24a1bdded576a19605fef9f9a70bc7ad4635aec399181b89c3e98f WatchSource:0}: Error finding container 7e6015920a24a1bdded576a19605fef9f9a70bc7ad4635aec399181b89c3e98f: Status 404 returned error can't find the container with id 7e6015920a24a1bdded576a19605fef9f9a70bc7ad4635aec399181b89c3e98f Jul 07 14:56:55.100992 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:55.100886 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6cd7f9_5d3e_4942_ba66_6718a04797ed.slice/crio-9550eb62e6308c91375db6ee0ddbdd10d4e45133d81df1a0295405690781e567 WatchSource:0}: Error finding container 9550eb62e6308c91375db6ee0ddbdd10d4e45133d81df1a0295405690781e567: Status 404 returned error can't find the container with id 9550eb62e6308c91375db6ee0ddbdd10d4e45133d81df1a0295405690781e567 Jul 07 14:56:55.102460 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:55.102362 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3db4e78_b1b3_4eec_8a2a_b7073355e415.slice/crio-f5b3ac503fa867a84e6106013e649f8685996010d3cd9fe7ee29c7c5868b3188 WatchSource:0}: Error finding container f5b3ac503fa867a84e6106013e649f8685996010d3cd9fe7ee29c7c5868b3188: Status 404 returned error can't find the container with id f5b3ac503fa867a84e6106013e649f8685996010d3cd9fe7ee29c7c5868b3188 Jul 07 14:56:55.103380 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:56:55.103341 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64f8801_c808_4e22_b18f_c73cb691cb11.slice/crio-92a673f6c3ee3b111ed248fc2e96c6ae082fdd646a0e17d9bc9c33d133840c39 WatchSource:0}: Error finding container 92a673f6c3ee3b111ed248fc2e96c6ae082fdd646a0e17d9bc9c33d133840c39: Status 404 returned error can't find the container with id 92a673f6c3ee3b111ed248fc2e96c6ae082fdd646a0e17d9bc9c33d133840c39 Jul 07 14:56:55.328242 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:55.327999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:55.328417 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.328191 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:55.328417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:55.328327 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:55.328417 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.328393 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret podName:2b611955-d7ce-493b-8d46-dcf31815c4bc nodeName:}" failed. No retries permitted until 2026-07-07 14:56:57.328368119 +0000 UTC m=+6.052269923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret") pod "global-pull-secret-syncer-mnjnx" (UID: "2b611955-d7ce-493b-8d46-dcf31815c4bc") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:55.328597 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.328446 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:55.328597 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.328497 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs podName:b10826e0-c841-4537-a855-18fd4d6ba933 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:57.328480596 +0000 UTC m=+6.052382395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs") pod "network-metrics-daemon-jhpg5" (UID: "b10826e0-c841-4537-a855-18fd4d6ba933") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:55.530147 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:55.530107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:55.530726 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.530353 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:56:55.530726 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.530381 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:56:55.530726 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.530394 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nvj84 for pod openshift-network-diagnostics/network-check-target-q8n52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:55.530726 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.530462 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84 podName:596f38b8-78a0-4915-bf9f-f8caed7e4238 nodeName:}" failed. No retries permitted until 2026-07-07 14:56:57.530442856 +0000 UTC m=+6.254344659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvj84" (UniqueName: "kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84") pod "network-check-target-q8n52" (UID: "596f38b8-78a0-4915-bf9f-f8caed7e4238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:55.748524 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:55.748433 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:51:53 +0000 UTC" deadline="2028-04-17 14:01:54.670205816 +0000 UTC" Jul 07 14:56:55.748524 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:55.748475 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15599h4m58.921734648s" Jul 07 14:56:55.985410 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:55.985379 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:55.985561 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.985528 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:56:55.986012 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:55.985993 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:55.986123 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:55.986101 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:56:56.018972 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.018894 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gdr2n" event={"ID":"0d6cd7f9-5d3e-4942-ba66-6718a04797ed","Type":"ContainerStarted","Data":"9550eb62e6308c91375db6ee0ddbdd10d4e45133d81df1a0295405690781e567"} Jul 07 14:56:56.026390 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.026363 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmlfj" event={"ID":"3b4f4f10-4697-4922-a85b-db05334e39fa","Type":"ContainerStarted","Data":"6e64cef58a50a8a79d003fd5d7cc14a1cfeaa48c55ae261177551e6645bb6fcc"} Jul 07 14:56:56.036931 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.036832 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"d96744341a326e9882c5474bdd638287c48bb09b6c446c4587765590fc9dd75b"} Jul 07 14:56:56.040690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.040666 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d27k9" event={"ID":"c64f8801-c808-4e22-b18f-c73cb691cb11","Type":"ContainerStarted","Data":"92a673f6c3ee3b111ed248fc2e96c6ae082fdd646a0e17d9bc9c33d133840c39"} Jul 07 14:56:56.042597 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.042530 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerStarted","Data":"7e6015920a24a1bdded576a19605fef9f9a70bc7ad4635aec399181b89c3e98f"} Jul 07 14:56:56.044800 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.044741 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mm72" event={"ID":"8133a451-bdd4-4bef-8a92-f3675f59cab0","Type":"ContainerStarted","Data":"47d572588332668ac6d2dcbd6153404d3a0b47016afc85e6e3dd44a7c1d4a066"} Jul 07 14:56:56.064934 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.064349 2582 generic.go:356] "Generic (PLEG): container finished" podID="b858ed709bf065b9b08e83e7da03d712" containerID="4478f5cd4a93ffe3dfad30eb1d62a6847c979ec8c72dffff827ada093cb385a4" exitCode=0 Jul 07 14:56:56.064934 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.064568 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" event={"ID":"b858ed709bf065b9b08e83e7da03d712","Type":"ContainerDied","Data":"4478f5cd4a93ffe3dfad30eb1d62a6847c979ec8c72dffff827ada093cb385a4"} Jul 07 14:56:56.075578 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.075188 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" event={"ID":"6245624462c264761e6bc0bdfd40a9df","Type":"ContainerStarted","Data":"5ad97c57bb5bbab260fe240acfa807b048eea5f0174882152fd00e62a04fe13b"} Jul 07 14:56:56.092303 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.092228 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" event={"ID":"f3db4e78-b1b3-4eec-8a2a-b7073355e415","Type":"ContainerStarted","Data":"f5b3ac503fa867a84e6106013e649f8685996010d3cd9fe7ee29c7c5868b3188"} Jul 07 14:56:56.984423 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:56.984347 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:56.984831 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:56.984485 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:56:57.102825 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:57.102759 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" event={"ID":"b858ed709bf065b9b08e83e7da03d712","Type":"ContainerStarted","Data":"03704c45ebc3c07dbcdb1ca24b4c673ba14d34a745b1a9cfb985b7eaa6665fdb"} Jul 07 14:56:57.120314 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:57.119389 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-141.ec2.internal" podStartSLOduration=4.119370048 podStartE2EDuration="4.119370048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:56:56.105984262 +0000 UTC m=+4.829886081" watchObservedRunningTime="2026-07-07 14:56:57.119370048 +0000 UTC m=+5.843271866" Jul 07 14:56:57.346500 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:57.346409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:57.346500 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:57.346471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:57.346704 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.346618 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:57.346704 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.346679 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret podName:2b611955-d7ce-493b-8d46-dcf31815c4bc nodeName:}" failed. No retries permitted until 2026-07-07 14:57:01.346657772 +0000 UTC m=+10.070559585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret") pod "global-pull-secret-syncer-mnjnx" (UID: "2b611955-d7ce-493b-8d46-dcf31815c4bc") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:56:57.347031 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.346931 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:57.347031 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.347000 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs podName:b10826e0-c841-4537-a855-18fd4d6ba933 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:01.346981088 +0000 UTC m=+10.070882887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs") pod "network-metrics-daemon-jhpg5" (UID: "b10826e0-c841-4537-a855-18fd4d6ba933") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:56:57.549678 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:57.548882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:57.549678 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.549119 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:56:57.549678 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.549139 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:56:57.549678 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.549152 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nvj84 for pod openshift-network-diagnostics/network-check-target-q8n52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:57.549678 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.549244 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84 podName:596f38b8-78a0-4915-bf9f-f8caed7e4238 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:01.549193407 +0000 UTC m=+10.273095257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvj84" (UniqueName: "kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84") pod "network-check-target-q8n52" (UID: "596f38b8-78a0-4915-bf9f-f8caed7e4238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:56:57.984956 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:57.984556 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:57.984956 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.984673 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:56:57.985531 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:57.985114 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:57.985531 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:57.985227 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:56:58.984750 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:58.984263 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:56:58.984750 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:58.984402 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:56:59.984858 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:59.984779 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:56:59.985336 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:59.984927 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:56:59.985336 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:56:59.985149 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:56:59.985336 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:56:59.985244 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:00.984926 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:00.984893 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:00.985388 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:00.985019 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:01.380555 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:01.380402 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:01.380555 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:01.380534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:01.380773 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.380688 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:01.380773 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.380694 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:01.380773 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.380751 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret podName:2b611955-d7ce-493b-8d46-dcf31815c4bc nodeName:}" failed. No retries permitted until 2026-07-07 14:57:09.380732668 +0000 UTC m=+18.104634465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret") pod "global-pull-secret-syncer-mnjnx" (UID: "2b611955-d7ce-493b-8d46-dcf31815c4bc") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:01.380773 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.380770 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs podName:b10826e0-c841-4537-a855-18fd4d6ba933 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:09.380760534 +0000 UTC m=+18.104662334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs") pod "network-metrics-daemon-jhpg5" (UID: "b10826e0-c841-4537-a855-18fd4d6ba933") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:01.581999 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:01.581965 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:01.582238 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.582144 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:57:01.582238 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.582163 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:57:01.582238 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.582172 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nvj84 for pod openshift-network-diagnostics/network-check-target-q8n52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:01.582238 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.582235 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84 podName:596f38b8-78a0-4915-bf9f-f8caed7e4238 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:09.582215621 +0000 UTC m=+18.306117499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvj84" (UniqueName: "kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84") pod "network-check-target-q8n52" (UID: "596f38b8-78a0-4915-bf9f-f8caed7e4238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:01.989123 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:01.988451 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:01.989123 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.988571 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:01.989123 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:01.988964 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:01.989123 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:01.989085 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:02.985254 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:02.985164 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:02.985412 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:02.985301 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:03.984880 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:03.984811 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:03.985295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:03.984811 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:03.985295 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:03.984996 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:03.985295 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:03.985109 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:04.984751 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:04.984712 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:04.984910 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:04.984831 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:05.985264 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:05.985231 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:05.985680 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:05.985231 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:05.985680 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:05.985362 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:05.985680 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:05.985465 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:06.984699 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:06.984669 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:06.984859 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:06.984788 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:07.985208 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:07.985174 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:07.985576 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:07.985174 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:07.985576 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:07.985302 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:07.985576 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:07.985355 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:08.984692 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:08.984658 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:08.984927 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:08.984775 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:09.443167 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:09.443138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:09.443528 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:09.443174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:09.443528 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.443273 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:09.443528 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.443275 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:09.443528 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.443318 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret podName:2b611955-d7ce-493b-8d46-dcf31815c4bc nodeName:}" failed. No retries permitted until 2026-07-07 14:57:25.44330475 +0000 UTC m=+34.167206546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret") pod "global-pull-secret-syncer-mnjnx" (UID: "2b611955-d7ce-493b-8d46-dcf31815c4bc") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:09.443528 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.443332 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs podName:b10826e0-c841-4537-a855-18fd4d6ba933 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:25.443325349 +0000 UTC m=+34.167227145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs") pod "network-metrics-daemon-jhpg5" (UID: "b10826e0-c841-4537-a855-18fd4d6ba933") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:09.644460 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:09.644432 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:09.644605 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.644568 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:57:09.644605 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.644588 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:57:09.644605 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.644598 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nvj84 for pod openshift-network-diagnostics/network-check-target-q8n52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:09.644703 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.644641 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84 podName:596f38b8-78a0-4915-bf9f-f8caed7e4238 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:25.644628912 +0000 UTC m=+34.368530708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvj84" (UniqueName: "kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84") pod "network-check-target-q8n52" (UID: "596f38b8-78a0-4915-bf9f-f8caed7e4238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:09.985106 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:09.985073 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:09.985273 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:09.985112 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:09.985273 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.985212 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:09.985405 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:09.985345 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:10.984447 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:10.984417 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:10.984895 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:10.984542 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:11.985957 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:11.985923 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:11.986394 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:11.986052 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:11.986394 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:11.986095 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:11.986394 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:11.986204 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:12.984836 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:12.984803 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:12.984992 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:12.984943 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:13.985346 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:13.985291 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:13.985772 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:13.985400 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:13.985772 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:13.985497 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:13.985772 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:13.985611 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:14.136238 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.136194 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gdr2n" event={"ID":"0d6cd7f9-5d3e-4942-ba66-6718a04797ed","Type":"ContainerStarted","Data":"d8ac65d6ba8817c99e43c99c2b8d9f63721ec5f5e60dafcaf8172f78622d3d9f"} Jul 07 14:57:14.137664 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.137637 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xmlfj" event={"ID":"3b4f4f10-4697-4922-a85b-db05334e39fa","Type":"ContainerStarted","Data":"9c9f2a0f2cc8af1bd35731d7501543a280559eba1bb82a71d5d4f9ac52111024"} Jul 07 14:57:14.139264 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.139240 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zzp9g" event={"ID":"5df3e50e-b9a9-4128-9af0-13c3c94d04c6","Type":"ContainerStarted","Data":"c9e6120a6a033bc0dfb420f525be27da165d0ce85e9e5c5c026a70adda80f88d"} Jul 07 14:57:14.140683 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.140664 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d27k9" event={"ID":"c64f8801-c808-4e22-b18f-c73cb691cb11","Type":"ContainerStarted","Data":"8486468b9ea4448fed200b6d849c1511ae7bfbe45d672200c94b7fdc4d4358d4"} Jul 07 14:57:14.142203 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.142179 2582 generic.go:356] "Generic (PLEG): container finished" podID="4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e" containerID="4534493e764ca9d817374448fb105a63aa813778602cad0e39f3cf212806c768" exitCode=0 Jul 07 14:57:14.142278 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.142261 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerDied","Data":"4534493e764ca9d817374448fb105a63aa813778602cad0e39f3cf212806c768"} Jul 07 14:57:14.144163 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.143835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7mm72" event={"ID":"8133a451-bdd4-4bef-8a92-f3675f59cab0","Type":"ContainerStarted","Data":"385799b740563760929586b1e6a4dd21518e32fa9e9403490462afe19b2feeb5"} Jul 07 14:57:14.147200 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.147183 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" event={"ID":"f3db4e78-b1b3-4eec-8a2a-b7073355e415","Type":"ContainerStarted","Data":"f68cfd69cee2cbb6fd73503d7a2484e76ac9157ba629d6f0d68b45769a1e1e06"} Jul 07 14:57:14.152585 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.152538 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-141.ec2.internal" podStartSLOduration=21.152527823 podStartE2EDuration="21.152527823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:56:57.120298468 +0000 UTC m=+5.844200286" watchObservedRunningTime="2026-07-07 14:57:14.152527823 +0000 UTC m=+22.876429641" Jul 07 14:57:14.179547 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.179505 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gdr2n" podStartSLOduration=3.60884672 podStartE2EDuration="22.179491678s" totalImagesPullingTime="18.570644958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:14.152644632 +0000 UTC m=+22.876546480" watchObservedRunningTime="2026-07-07 14:57:14.179491678 +0000 UTC m=+22.903393495" Jul 07 14:57:14.201369 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.201332 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xmlfj" podStartSLOduration=3.547790755 podStartE2EDuration="22.201318472s" totalImagesPullingTime="18.653527717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:14.201141431 +0000 UTC m=+22.925043250" watchObservedRunningTime="2026-07-07 14:57:14.201318472 +0000 UTC m=+22.925220290" Jul 07 14:57:14.253241 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.253198 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zzp9g" podStartSLOduration=10.967267634 podStartE2EDuration="22.253181356s" totalImagesPullingTime="11.285913722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:14.227899289 +0000 UTC m=+22.951801107" watchObservedRunningTime="2026-07-07 14:57:14.253181356 +0000 UTC m=+22.977083173" Jul 07 14:57:14.304299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.304260 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7mm72" podStartSLOduration=3.694861661 podStartE2EDuration="22.304245088s" totalImagesPullingTime="18.609383427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:14.253310944 +0000 UTC m=+22.977212750" watchObservedRunningTime="2026-07-07 14:57:14.304245088 +0000 UTC m=+23.028146906" Jul 07 14:57:14.572652 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.572465 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:57:14.984523 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:14.984492 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:14.984679 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:14.984637 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:15.150848 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.150817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwfgt" event={"ID":"d6399bef-6d74-4bcc-b53d-41b4dc6e2d01","Type":"ContainerStarted","Data":"9ce064358535e3c167caadca3491821e1ea963cb30b6174484d2e340dad0ed31"} Jul 07 14:57:15.154350 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.154330 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 14:57:15.154753 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.154695 2582 generic.go:356] "Generic (PLEG): container finished" podID="571df583-610b-4655-8dde-1c579bbbc2be" containerID="d46e3dabe90a45ad0a248d5152b4abe20d1e9f807df052616ff163c677bc17ee" exitCode=1 Jul 07 14:57:15.155347 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.155316 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"4e2e80562f7ebff60ddd6f21be9de91801aba51e04e34be09a341403466b1dbf"} Jul 07 14:57:15.155444 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.155406 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"fe2c708db35327d1c22c7426ee3ea39bc830451403469320db25e42779a44717"} Jul 07 14:57:15.155508 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.155448 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"14b475122291d74475f4cd211ed7b00cc8732071941b5d78851597e947aaf15c"} Jul 07 14:57:15.155508 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.155498 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"69cc8fa8bca96d026308d27d0b58f02b4a74acdf66fde4554dfacd73f5911ee5"} Jul 07 14:57:15.155613 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.155547 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerDied","Data":"d46e3dabe90a45ad0a248d5152b4abe20d1e9f807df052616ff163c677bc17ee"} Jul 07 14:57:15.155613 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.155598 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"138b983597b05e189ffd7c04439fb0058453c354527d78f7ca0bf887b6095a6c"} Jul 07 14:57:15.169392 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.169356 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d27k9" podStartSLOduration=4.573468763 podStartE2EDuration="23.169344772s" totalImagesPullingTime="18.595876009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:14.315938039 +0000 UTC m=+23.039839856" watchObservedRunningTime="2026-07-07 14:57:15.169344772 +0000 UTC m=+23.893246590" Jul 07 14:57:15.188931 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.188906 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:57:15.779765 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.779620 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:57:15.188926508Z","UUID":"94e128f1-bfde-4e27-bbb6-b8a1e498c8b5","Handler":null,"Name":"","Endpoint":""} Jul 07 14:57:15.781376 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.781356 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:57:15.781485 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.781396 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:57:15.985445 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.985117 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:15.985445 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:15.985255 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:15.985445 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:15.985275 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:15.985445 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:15.985382 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:16.159388 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:16.159356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" event={"ID":"f3db4e78-b1b3-4eec-8a2a-b7073355e415","Type":"ContainerStarted","Data":"dd4ab5b6f80dd09ff9d95bf04c76de4d6bdfd7401b80cf51d7338ad04d38ee52"} Jul 07 14:57:16.985364 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:16.985202 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:16.985503 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:16.985461 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:17.163994 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:17.163957 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" event={"ID":"f3db4e78-b1b3-4eec-8a2a-b7073355e415","Type":"ContainerStarted","Data":"05c0a1b7328e75f414b4ed4458709754dda68994fdefb84e6b35d7f0158e89d0"} Jul 07 14:57:17.193819 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:17.193754 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qwfgt" podStartSLOduration=5.872851156 podStartE2EDuration="25.193735713s" totalImagesPullingTime="19.320884557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:15.170328544 +0000 UTC m=+23.894230363" watchObservedRunningTime="2026-07-07 14:57:17.193735713 +0000 UTC m=+25.917637532" Jul 07 14:57:17.654034 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:17.654006 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:57:17.654708 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:17.654687 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:57:17.673477 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:17.673428 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x49dg" podStartSLOduration=4.983661118 podStartE2EDuration="25.673408969s" totalImagesPullingTime="20.689747851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:17.19322746 +0000 UTC m=+25.917129273" watchObservedRunningTime="2026-07-07 14:57:17.673408969 +0000 UTC m=+26.397310790" Jul 07 14:57:17.985030 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:17.984960 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:17.985197 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:17.985119 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:17.985197 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:17.985168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:17.985309 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:17.985249 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:18.166367 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:18.166343 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d27k9" Jul 07 14:57:18.984774 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:18.984750 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:18.984921 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:18.984838 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:19.170230 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:19.170205 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 14:57:19.170862 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:19.170558 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"42ccb63509cf7377a1ecf683b81fd53d817cc12cdc6fd26ace42c23faf4fb9e6"} Jul 07 14:57:19.172295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:19.172272 2582 generic.go:356] "Generic (PLEG): container finished" podID="4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e" containerID="dd989c8d3ceb4e34f4c55295d36fca08a8162144d9f6bf4470ac5774824992da" exitCode=0 Jul 07 14:57:19.172400 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:19.172348 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerDied","Data":"dd989c8d3ceb4e34f4c55295d36fca08a8162144d9f6bf4470ac5774824992da"} Jul 07 14:57:19.984407 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:19.984382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:19.984407 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:19.984391 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:19.984610 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:19.984473 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:19.984610 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:19.984596 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:20.984556 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:20.984385 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:20.985028 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:20.984625 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:21.178849 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.178821 2582 generic.go:356] "Generic (PLEG): container finished" podID="4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e" containerID="0ad447b23073b530fa46cfa11df02ebd1e0baf53936431fb6fe310153092f57a" exitCode=0 Jul 07 14:57:21.178973 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.178902 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerDied","Data":"0ad447b23073b530fa46cfa11df02ebd1e0baf53936431fb6fe310153092f57a"} Jul 07 14:57:21.182142 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.182123 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 14:57:21.182433 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.182414 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"da3011097f8b1e78dad14e907ed7cd5bd371507de066780679f827a53cc50143"} Jul 07 14:57:21.182635 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.182622 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:57:21.182709 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.182665 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:57:21.182866 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.182850 2582 scope.go:117] "RemoveContainer" containerID="d46e3dabe90a45ad0a248d5152b4abe20d1e9f807df052616ff163c677bc17ee" Jul 07 14:57:21.198943 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.198927 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:57:21.985272 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.985241 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:21.985684 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:21.985305 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:21.985684 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:21.985323 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:21.985684 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:21.985395 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:22.187969 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.187947 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 14:57:22.188423 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.188391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" event={"ID":"571df583-610b-4655-8dde-1c579bbbc2be","Type":"ContainerStarted","Data":"fb486defb9c1159b3ea7bc5ef93a8df2cec682cc289272f72c02204078bbce92"} Jul 07 14:57:22.188865 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.188843 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:57:22.191311 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.191283 2582 generic.go:356] "Generic (PLEG): container finished" podID="4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e" containerID="6de4ec9e888a605cc72fa707f21aa161057da9d27fea8c785917b67895727a2f" exitCode=0 Jul 07 14:57:22.191408 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.191324 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerDied","Data":"6de4ec9e888a605cc72fa707f21aa161057da9d27fea8c785917b67895727a2f"} Jul 07 14:57:22.206148 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.206128 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:57:22.225607 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.225383 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" podStartSLOduration=11.225778267 podStartE2EDuration="30.225364695s" totalImagesPullingTime="18.999586428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:22.223481852 +0000 UTC m=+30.947383671" watchObservedRunningTime="2026-07-07 14:57:22.225364695 +0000 UTC m=+30.949266517" Jul 07 14:57:22.370303 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.369840 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jhpg5"] Jul 07 14:57:22.370303 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.369977 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:22.370303 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:22.370139 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:22.371288 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.371086 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnjnx"] Jul 07 14:57:22.371288 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.371189 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:22.371288 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:22.371278 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:22.371761 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.371728 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q8n52"] Jul 07 14:57:22.371863 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:22.371821 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:22.371942 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:22.371904 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:23.984759 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:23.984573 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:23.985255 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:23.984573 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:23.985255 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:23.984855 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:23.985255 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:23.984934 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:23.985255 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:23.984573 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:23.985255 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:23.985041 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:25.468567 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:25.468525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:25.469188 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:25.468612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:25.469188 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.468687 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:25.469188 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.468711 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:25.469188 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.468753 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret podName:2b611955-d7ce-493b-8d46-dcf31815c4bc nodeName:}" failed. No retries permitted until 2026-07-07 14:57:57.468736776 +0000 UTC m=+66.192638576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret") pod "global-pull-secret-syncer-mnjnx" (UID: "2b611955-d7ce-493b-8d46-dcf31815c4bc") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:57:25.469188 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.468775 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs podName:b10826e0-c841-4537-a855-18fd4d6ba933 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:57.468763571 +0000 UTC m=+66.192665401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs") pod "network-metrics-daemon-jhpg5" (UID: "b10826e0-c841-4537-a855-18fd4d6ba933") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:57:25.670054 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:25.670023 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:25.670231 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.670211 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:57:25.670289 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.670238 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:57:25.670289 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.670252 2582 projected.go:196] Error preparing data for projected volume kube-api-access-nvj84 for pod openshift-network-diagnostics/network-check-target-q8n52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:25.670373 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.670313 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84 podName:596f38b8-78a0-4915-bf9f-f8caed7e4238 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:57.670294111 +0000 UTC m=+66.394195921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvj84" (UniqueName: "kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84") pod "network-check-target-q8n52" (UID: "596f38b8-78a0-4915-bf9f-f8caed7e4238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:57:25.985028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:25.984991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:25.985028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:25.985009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:25.985265 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.985132 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnjnx" podUID="2b611955-d7ce-493b-8d46-dcf31815c4bc" Jul 07 14:57:25.985265 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.985205 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhpg5" podUID="b10826e0-c841-4537-a855-18fd4d6ba933" Jul 07 14:57:25.985265 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:25.985219 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:25.985403 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:25.985303 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8n52" podUID="596f38b8-78a0-4915-bf9f-f8caed7e4238" Jul 07 14:57:26.463205 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.463184 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-141.ec2.internal" event="NodeReady" Jul 07 14:57:26.463328 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.463318 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:57:26.499829 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.499789 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f587d767f-brdpb"] Jul 07 14:57:26.501381 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.501366 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.504684 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.504659 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:57:26.504788 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.504659 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:57:26.505470 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.505454 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dqrsp\"" Jul 07 14:57:26.505554 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.505482 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:57:26.513899 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.513883 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:57:26.517155 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.517013 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f587d767f-brdpb"] Jul 07 14:57:26.520273 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.520253 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nxd4t"] Jul 07 14:57:26.521855 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.521839 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.522857 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.522838 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p57rc"] Jul 07 14:57:26.524321 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.524307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.524375 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.524364 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:57:26.524411 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.524375 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jkfb7\"" Jul 07 14:57:26.524771 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.524754 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:57:26.527303 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.527286 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kbzh7\"" Jul 07 14:57:26.527393 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.527318 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:57:26.527632 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.527607 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:57:26.527632 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.527624 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:57:26.537014 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.536989 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nxd4t"] Jul 07 14:57:26.549723 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.549703 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p57rc"] Jul 07 14:57:26.677152 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-image-registry-private-configuration\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.677152 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a14c5597-1d75-4ff2-8383-474cbe2efb0e-config-volume\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.677281 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-installation-pull-secrets\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.677281 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677192 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mswnb\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-kube-api-access-mswnb\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.677281 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677246 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-certificates\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.677281 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677263 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.677401 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a14c5597-1d75-4ff2-8383-474cbe2efb0e-tmp-dir\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.677401 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677341 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-bound-sa-token\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.677401 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9caa6f1-8fe7-4116-b09f-59f6a24a802f-cert\") pod \"ingress-canary-p57rc\" (UID: \"b9caa6f1-8fe7-4116-b09f-59f6a24a802f\") " pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.677401 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03526a0a-c604-4d13-afe2-3ad062ed91a1-ca-trust-extracted\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.677516 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29h2p\" (UniqueName: \"kubernetes.io/projected/b9caa6f1-8fe7-4116-b09f-59f6a24a802f-kube-api-access-29h2p\") pod \"ingress-canary-p57rc\" (UID: \"b9caa6f1-8fe7-4116-b09f-59f6a24a802f\") " pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.677516 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677419 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-trusted-ca\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.677516 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzlbj\" (UniqueName: \"kubernetes.io/projected/a14c5597-1d75-4ff2-8383-474cbe2efb0e-kube-api-access-mzlbj\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.677516 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.677467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778241 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-trusted-ca\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778281 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzlbj\" (UniqueName: \"kubernetes.io/projected/a14c5597-1d75-4ff2-8383-474cbe2efb0e-kube-api-access-mzlbj\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.778461 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778461 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778342 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-image-registry-private-configuration\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778461 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778365 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a14c5597-1d75-4ff2-8383-474cbe2efb0e-config-volume\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.778461 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778410 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-installation-pull-secrets\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778461 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mswnb\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-kube-api-access-mswnb\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778470 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-certificates\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778494 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778518 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a14c5597-1d75-4ff2-8383-474cbe2efb0e-tmp-dir\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-bound-sa-token\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778571 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9caa6f1-8fe7-4116-b09f-59f6a24a802f-cert\") pod \"ingress-canary-p57rc\" (UID: \"b9caa6f1-8fe7-4116-b09f-59f6a24a802f\") " pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778597 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03526a0a-c604-4d13-afe2-3ad062ed91a1-ca-trust-extracted\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29h2p\" (UniqueName: \"kubernetes.io/projected/b9caa6f1-8fe7-4116-b09f-59f6a24a802f-kube-api-access-29h2p\") pod \"ingress-canary-p57rc\" (UID: \"b9caa6f1-8fe7-4116-b09f-59f6a24a802f\") " pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:26.778473 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:26.778690 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:26.778669 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f587d767f-brdpb: secret "image-registry-tls" not found Jul 07 14:57:26.779051 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:26.778736 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls podName:03526a0a-c604-4d13-afe2-3ad062ed91a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:27.278715907 +0000 UTC m=+36.002617703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls") pod "image-registry-6f587d767f-brdpb" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1") : secret "image-registry-tls" not found Jul 07 14:57:26.779051 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778879 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a14c5597-1d75-4ff2-8383-474cbe2efb0e-tmp-dir\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.779051 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:26.778641 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:26.779051 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:26.778980 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls podName:a14c5597-1d75-4ff2-8383-474cbe2efb0e nodeName:}" failed. No retries permitted until 2026-07-07 14:57:27.278965878 +0000 UTC m=+36.002867677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls") pod "dns-default-nxd4t" (UID: "a14c5597-1d75-4ff2-8383-474cbe2efb0e") : secret "dns-default-metrics-tls" not found Jul 07 14:57:26.779051 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.778976 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a14c5597-1d75-4ff2-8383-474cbe2efb0e-config-volume\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.779319 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.779239 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-certificates\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.779362 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.779315 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03526a0a-c604-4d13-afe2-3ad062ed91a1-ca-trust-extracted\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.779414 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.779395 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-trusted-ca\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.782521 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.782495 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-image-registry-private-configuration\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.782521 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.782516 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9caa6f1-8fe7-4116-b09f-59f6a24a802f-cert\") pod \"ingress-canary-p57rc\" (UID: \"b9caa6f1-8fe7-4116-b09f-59f6a24a802f\") " pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.782648 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.782501 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-installation-pull-secrets\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.790596 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.790573 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29h2p\" (UniqueName: \"kubernetes.io/projected/b9caa6f1-8fe7-4116-b09f-59f6a24a802f-kube-api-access-29h2p\") pod \"ingress-canary-p57rc\" (UID: \"b9caa6f1-8fe7-4116-b09f-59f6a24a802f\") " pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.790676 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.790638 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-bound-sa-token\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.790713 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.790676 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mswnb\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-kube-api-access-mswnb\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:26.791225 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.791210 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzlbj\" (UniqueName: \"kubernetes.io/projected/a14c5597-1d75-4ff2-8383-474cbe2efb0e-kube-api-access-mzlbj\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:26.835671 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.835653 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p57rc" Jul 07 14:57:26.960222 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:26.960046 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p57rc"] Jul 07 14:57:26.963364 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:26.963336 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9caa6f1_8fe7_4116_b09f_59f6a24a802f.slice/crio-3133984ab24d9ee07970813eaa556627119c4d54e3f55d002ceedcf6a57ad240 WatchSource:0}: Error finding container 3133984ab24d9ee07970813eaa556627119c4d54e3f55d002ceedcf6a57ad240: Status 404 returned error can't find the container with id 3133984ab24d9ee07970813eaa556627119c4d54e3f55d002ceedcf6a57ad240 Jul 07 14:57:27.206820 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.206794 2582 generic.go:356] "Generic (PLEG): container finished" podID="4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e" containerID="56bf739bfae6da81c2311e8a9f930cd417f46bdb32ba19287092632b096d7ce7" exitCode=0 Jul 07 14:57:27.206963 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.206866 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerDied","Data":"56bf739bfae6da81c2311e8a9f930cd417f46bdb32ba19287092632b096d7ce7"} Jul 07 14:57:27.207921 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.207893 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p57rc" event={"ID":"b9caa6f1-8fe7-4116-b09f-59f6a24a802f","Type":"ContainerStarted","Data":"3133984ab24d9ee07970813eaa556627119c4d54e3f55d002ceedcf6a57ad240"} Jul 07 14:57:27.283511 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.283489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:27.283607 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.283546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:27.283648 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:27.283631 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:27.283694 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:27.283684 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls podName:a14c5597-1d75-4ff2-8383-474cbe2efb0e nodeName:}" failed. No retries permitted until 2026-07-07 14:57:28.283670838 +0000 UTC m=+37.007572637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls") pod "dns-default-nxd4t" (UID: "a14c5597-1d75-4ff2-8383-474cbe2efb0e") : secret "dns-default-metrics-tls" not found Jul 07 14:57:27.283742 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:27.283634 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:27.283742 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:27.283720 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f587d767f-brdpb: secret "image-registry-tls" not found Jul 07 14:57:27.283816 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:27.283761 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls podName:03526a0a-c604-4d13-afe2-3ad062ed91a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:28.283749911 +0000 UTC m=+37.007651711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls") pod "image-registry-6f587d767f-brdpb" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1") : secret "image-registry-tls" not found Jul 07 14:57:27.985443 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.985406 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:27.985971 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.985407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:27.985971 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.985960 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:27.990019 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.989850 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:57:27.990019 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.989875 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:57:27.990853 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.990735 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:57:27.990853 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.990730 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:57:27.990853 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.990792 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb9sm\"" Jul 07 14:57:27.991089 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:27.990854 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4xq58\"" Jul 07 14:57:28.213771 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:28.213732 2582 generic.go:356] "Generic (PLEG): container finished" podID="4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e" containerID="9c5e3f65247595cb91a1c1b9313a8da9b70658d54590da06ceef6e2e8a8c35a9" exitCode=0 Jul 07 14:57:28.213945 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:28.213803 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerDied","Data":"9c5e3f65247595cb91a1c1b9313a8da9b70658d54590da06ceef6e2e8a8c35a9"} Jul 07 14:57:28.290086 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:28.290047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:28.290204 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:28.290125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:28.290204 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:28.290183 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:28.290304 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:28.290243 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:28.290304 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:28.290252 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls podName:a14c5597-1d75-4ff2-8383-474cbe2efb0e nodeName:}" failed. No retries permitted until 2026-07-07 14:57:30.290231397 +0000 UTC m=+39.014133218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls") pod "dns-default-nxd4t" (UID: "a14c5597-1d75-4ff2-8383-474cbe2efb0e") : secret "dns-default-metrics-tls" not found Jul 07 14:57:28.290304 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:28.290253 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f587d767f-brdpb: secret "image-registry-tls" not found Jul 07 14:57:28.290457 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:28.290307 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls podName:03526a0a-c604-4d13-afe2-3ad062ed91a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:30.290282199 +0000 UTC m=+39.014184017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls") pod "image-registry-6f587d767f-brdpb" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1") : secret "image-registry-tls" not found Jul 07 14:57:29.218805 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:29.218773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8szxz" event={"ID":"4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e","Type":"ContainerStarted","Data":"fb572e9ea3944fdb96a943529ae0758d175d7416557e031e34b49983c340de6c"} Jul 07 14:57:29.244634 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:29.244590 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8szxz" podStartSLOduration=8.470246336 podStartE2EDuration="37.244575414s" totalImagesPullingTime="28.774329078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:29.244365324 +0000 UTC m=+37.968267167" watchObservedRunningTime="2026-07-07 14:57:29.244575414 +0000 UTC m=+37.968477232" Jul 07 14:57:30.222281 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:30.222093 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p57rc" event={"ID":"b9caa6f1-8fe7-4116-b09f-59f6a24a802f","Type":"ContainerStarted","Data":"49203ad5b578e008df59241e2190085f5aad18bf7592376cb26ade3634a8df85"} Jul 07 14:57:30.240184 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:30.240145 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p57rc" podStartSLOduration=1.910980243 podStartE2EDuration="4.240131054s" totalImagesPullingTime="2.329150811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:30.23879538 +0000 UTC m=+38.962697199" watchObservedRunningTime="2026-07-07 14:57:30.240131054 +0000 UTC m=+38.964032871" Jul 07 14:57:30.304552 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:30.304516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:30.304677 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:30.304613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:30.304677 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:30.304667 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:30.304747 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:30.304685 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f587d767f-brdpb: secret "image-registry-tls" not found Jul 07 14:57:30.304747 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:30.304702 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:30.304801 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:30.304747 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls podName:03526a0a-c604-4d13-afe2-3ad062ed91a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.30472992 +0000 UTC m=+43.028631729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls") pod "image-registry-6f587d767f-brdpb" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1") : secret "image-registry-tls" not found Jul 07 14:57:30.304801 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:30.304762 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls podName:a14c5597-1d75-4ff2-8383-474cbe2efb0e nodeName:}" failed. No retries permitted until 2026-07-07 14:57:34.304755407 +0000 UTC m=+43.028657203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls") pod "dns-default-nxd4t" (UID: "a14c5597-1d75-4ff2-8383-474cbe2efb0e") : secret "dns-default-metrics-tls" not found Jul 07 14:57:33.717791 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.717754 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c5q6l"] Jul 07 14:57:33.749911 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.749884 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2"] Jul 07 14:57:33.750034 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.750005 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:33.752858 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.752835 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 14:57:33.752858 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.752847 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:57:33.753177 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.752888 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:57:33.753258 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.753231 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qkqql\"" Jul 07 14:57:33.754115 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.754100 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 14:57:33.758465 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.758446 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 14:57:33.767471 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.767454 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2"] Jul 07 14:57:33.767544 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.767481 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c5q6l"] Jul 07 14:57:33.767544 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.767541 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" Jul 07 14:57:33.770222 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.770199 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:57:33.770222 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.770222 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 14:57:33.770419 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.770407 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dbxgq\"" Jul 07 14:57:33.827473 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.827453 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2h9nl"] Jul 07 14:57:33.851711 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.851691 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2h9nl"] Jul 07 14:57:33.851789 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.851762 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:33.855684 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.855662 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 14:57:33.855782 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.855717 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 14:57:33.855856 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.855792 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 14:57:33.856991 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.856972 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nzqv6\"" Jul 07 14:57:33.857103 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.857010 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:57:33.860972 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.860951 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 14:57:33.927078 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.927042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:33.927182 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.927104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-serving-cert\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:33.927246 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.927172 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-snapshots\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:33.927246 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.927206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:33.927344 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.927243 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw8bx\" (UniqueName: \"kubernetes.io/projected/9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a-kube-api-access-sw8bx\") pod \"volume-data-source-validator-5d456fdbcd-g7rk2\" (UID: \"9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" Jul 07 14:57:33.927344 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.927281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-tmp\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:33.927344 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:33.927305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxg48\" (UniqueName: \"kubernetes.io/projected/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-kube-api-access-jxg48\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.027600 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-tmp\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.027600 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027572 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxg48\" (UniqueName: \"kubernetes.io/projected/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-kube-api-access-jxg48\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.027600 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59e13c22-43a5-483c-8a1b-9ce8c804c107-config\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.027807 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027614 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb6mb\" (UniqueName: \"kubernetes.io/projected/59e13c22-43a5-483c-8a1b-9ce8c804c107-kube-api-access-rb6mb\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.027807 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59e13c22-43a5-483c-8a1b-9ce8c804c107-serving-cert\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.027807 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027746 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.027951 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027820 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59e13c22-43a5-483c-8a1b-9ce8c804c107-trusted-ca\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.027951 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027857 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-serving-cert\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.027951 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027902 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-snapshots\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.027951 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.028167 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw8bx\" (UniqueName: \"kubernetes.io/projected/9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a-kube-api-access-sw8bx\") pod \"volume-data-source-validator-5d456fdbcd-g7rk2\" (UID: \"9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" Jul 07 14:57:34.028167 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.027982 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-tmp\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.028395 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.028379 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-snapshots\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.028484 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.028463 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.028521 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.028471 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.031620 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.031603 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-serving-cert\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.036043 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.036021 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw8bx\" (UniqueName: \"kubernetes.io/projected/9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a-kube-api-access-sw8bx\") pod \"volume-data-source-validator-5d456fdbcd-g7rk2\" (UID: \"9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" Jul 07 14:57:34.036483 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.036463 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxg48\" (UniqueName: \"kubernetes.io/projected/60e1a7f9-f02f-475f-b8a6-73c07aa28ef1-kube-api-access-jxg48\") pod \"insights-operator-5c847dcfc4-c5q6l\" (UID: \"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1\") " pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.059381 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.059362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" Jul 07 14:57:34.075512 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.075493 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" Jul 07 14:57:34.128478 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.128452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59e13c22-43a5-483c-8a1b-9ce8c804c107-serving-cert\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.128616 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.128515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59e13c22-43a5-483c-8a1b-9ce8c804c107-trusted-ca\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.128616 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.128574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59e13c22-43a5-483c-8a1b-9ce8c804c107-config\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.128616 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.128598 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb6mb\" (UniqueName: \"kubernetes.io/projected/59e13c22-43a5-483c-8a1b-9ce8c804c107-kube-api-access-rb6mb\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.129559 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.129530 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59e13c22-43a5-483c-8a1b-9ce8c804c107-config\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.130249 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.129853 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59e13c22-43a5-483c-8a1b-9ce8c804c107-trusted-ca\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.131360 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.131339 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59e13c22-43a5-483c-8a1b-9ce8c804c107-serving-cert\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.137395 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.137372 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb6mb\" (UniqueName: \"kubernetes.io/projected/59e13c22-43a5-483c-8a1b-9ce8c804c107-kube-api-access-rb6mb\") pod \"console-operator-68b757fb67-2h9nl\" (UID: \"59e13c22-43a5-483c-8a1b-9ce8c804c107\") " pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.172575 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.172533 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:34.215701 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.215564 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-c5q6l"] Jul 07 14:57:34.217952 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:34.217923 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e1a7f9_f02f_475f_b8a6_73c07aa28ef1.slice/crio-5a196b6fdf8e0db4d59f19cbf01ce4ecefcc60e8bc68d681bb49b1a89f4d789a WatchSource:0}: Error finding container 5a196b6fdf8e0db4d59f19cbf01ce4ecefcc60e8bc68d681bb49b1a89f4d789a: Status 404 returned error can't find the container with id 5a196b6fdf8e0db4d59f19cbf01ce4ecefcc60e8bc68d681bb49b1a89f4d789a Jul 07 14:57:34.231937 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.231869 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" event={"ID":"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1","Type":"ContainerStarted","Data":"5a196b6fdf8e0db4d59f19cbf01ce4ecefcc60e8bc68d681bb49b1a89f4d789a"} Jul 07 14:57:34.234233 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.234213 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2"] Jul 07 14:57:34.236906 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:34.236886 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e798e2e_b860_4d6c_8b1e_4d35a7ca5f5a.slice/crio-a4284a45062a3d07656d5d1bc7394244921f48a5ea98a8a1e6e2d68f7e07837d WatchSource:0}: Error finding container a4284a45062a3d07656d5d1bc7394244921f48a5ea98a8a1e6e2d68f7e07837d: Status 404 returned error can't find the container with id a4284a45062a3d07656d5d1bc7394244921f48a5ea98a8a1e6e2d68f7e07837d Jul 07 14:57:34.323413 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.323386 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2h9nl"] Jul 07 14:57:34.326326 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:34.326306 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e13c22_43a5_483c_8a1b_9ce8c804c107.slice/crio-89954ffde57dda0782706ab0c64f28c30e03ea1c5919cfb8065df20918277a98 WatchSource:0}: Error finding container 89954ffde57dda0782706ab0c64f28c30e03ea1c5919cfb8065df20918277a98: Status 404 returned error can't find the container with id 89954ffde57dda0782706ab0c64f28c30e03ea1c5919cfb8065df20918277a98 Jul 07 14:57:34.329883 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.329865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:34.329963 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:34.329946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:34.330014 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:34.330000 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:34.330051 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:34.330017 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f587d767f-brdpb: secret "image-registry-tls" not found Jul 07 14:57:34.330111 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:34.330086 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls podName:03526a0a-c604-4d13-afe2-3ad062ed91a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:42.330055949 +0000 UTC m=+51.053957745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls") pod "image-registry-6f587d767f-brdpb" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1") : secret "image-registry-tls" not found Jul 07 14:57:34.330163 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:34.330126 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:34.330203 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:34.330184 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls podName:a14c5597-1d75-4ff2-8383-474cbe2efb0e nodeName:}" failed. No retries permitted until 2026-07-07 14:57:42.330166832 +0000 UTC m=+51.054068645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls") pod "dns-default-nxd4t" (UID: "a14c5597-1d75-4ff2-8383-474cbe2efb0e") : secret "dns-default-metrics-tls" not found Jul 07 14:57:35.236825 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:35.236791 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" event={"ID":"59e13c22-43a5-483c-8a1b-9ce8c804c107","Type":"ContainerStarted","Data":"89954ffde57dda0782706ab0c64f28c30e03ea1c5919cfb8065df20918277a98"} Jul 07 14:57:35.238580 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:35.238536 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" event={"ID":"9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a","Type":"ContainerStarted","Data":"a4284a45062a3d07656d5d1bc7394244921f48a5ea98a8a1e6e2d68f7e07837d"} Jul 07 14:57:36.684970 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.684939 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67"] Jul 07 14:57:36.701665 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.701592 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67"] Jul 07 14:57:36.701797 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.701721 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.722467 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.722446 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6tpzb\"" Jul 07 14:57:36.722568 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.722491 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:57:36.724148 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.724000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 14:57:36.724148 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.724026 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 14:57:36.724148 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.724036 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 14:57:36.850563 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.850530 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05ac1f53-dadd-4aa7-a572-ef6a13523d30-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.850736 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.850602 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6jjn\" (UniqueName: \"kubernetes.io/projected/05ac1f53-dadd-4aa7-a572-ef6a13523d30-kube-api-access-m6jjn\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.850736 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.850663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05ac1f53-dadd-4aa7-a572-ef6a13523d30-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.951507 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.951472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6jjn\" (UniqueName: \"kubernetes.io/projected/05ac1f53-dadd-4aa7-a572-ef6a13523d30-kube-api-access-m6jjn\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.951686 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.951526 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05ac1f53-dadd-4aa7-a572-ef6a13523d30-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.951686 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.951582 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05ac1f53-dadd-4aa7-a572-ef6a13523d30-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.952021 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.952001 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05ac1f53-dadd-4aa7-a572-ef6a13523d30-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.953635 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.953613 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05ac1f53-dadd-4aa7-a572-ef6a13523d30-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:36.960195 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:36.960178 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6jjn\" (UniqueName: \"kubernetes.io/projected/05ac1f53-dadd-4aa7-a572-ef6a13523d30-kube-api-access-m6jjn\") pod \"kube-storage-version-migrator-operator-846bf668f7-pjp67\" (UID: \"05ac1f53-dadd-4aa7-a572-ef6a13523d30\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:37.013590 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:37.013568 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" Jul 07 14:57:37.551738 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:37.550816 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67"] Jul 07 14:57:37.554436 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:37.554408 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ac1f53_dadd_4aa7_a572_ef6a13523d30.slice/crio-0a944ff160461cb52819075dea8878b06ee7f49cfedb0fb8162debf2760de67d WatchSource:0}: Error finding container 0a944ff160461cb52819075dea8878b06ee7f49cfedb0fb8162debf2760de67d: Status 404 returned error can't find the container with id 0a944ff160461cb52819075dea8878b06ee7f49cfedb0fb8162debf2760de67d Jul 07 14:57:38.248313 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.248280 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" event={"ID":"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1","Type":"ContainerStarted","Data":"87b13d4d072757a39b9a1f8125b9be706e701c55b84a1d72090b1a8d1e6a4f48"} Jul 07 14:57:38.249796 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.249770 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" event={"ID":"9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a","Type":"ContainerStarted","Data":"ba90bf19bcb6b3a00ba83c8ecf38f67bdc05c65f41a68da94b5a7caa1d2e9d06"} Jul 07 14:57:38.250887 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.250865 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" event={"ID":"05ac1f53-dadd-4aa7-a572-ef6a13523d30","Type":"ContainerStarted","Data":"0a944ff160461cb52819075dea8878b06ee7f49cfedb0fb8162debf2760de67d"} Jul 07 14:57:38.252346 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.252329 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/0.log" Jul 07 14:57:38.252417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.252363 2582 generic.go:356] "Generic (PLEG): container finished" podID="59e13c22-43a5-483c-8a1b-9ce8c804c107" containerID="9f4d2f994ebaa18eff2dea1e3c65124494a514adec32feba7758de67ff147e45" exitCode=255 Jul 07 14:57:38.252417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.252389 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" event={"ID":"59e13c22-43a5-483c-8a1b-9ce8c804c107","Type":"ContainerDied","Data":"9f4d2f994ebaa18eff2dea1e3c65124494a514adec32feba7758de67ff147e45"} Jul 07 14:57:38.252579 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.252568 2582 scope.go:117] "RemoveContainer" containerID="9f4d2f994ebaa18eff2dea1e3c65124494a514adec32feba7758de67ff147e45" Jul 07 14:57:38.266896 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.265826 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" podStartSLOduration=2.0563553470000002 podStartE2EDuration="5.265810202s" totalImagesPullingTime="3.209454855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:38.265236562 +0000 UTC m=+46.989138383" watchObservedRunningTime="2026-07-07 14:57:38.265810202 +0000 UTC m=+46.989712020" Jul 07 14:57:38.303704 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.303652 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-g7rk2" podStartSLOduration=2.147838355 podStartE2EDuration="5.303636607s" totalImagesPullingTime="3.155798252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:38.302993514 +0000 UTC m=+47.026895333" watchObservedRunningTime="2026-07-07 14:57:38.303636607 +0000 UTC m=+47.027538424" Jul 07 14:57:38.335944 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.334778 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jn94p"] Jul 07 14:57:38.369840 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.369798 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jn94p"] Jul 07 14:57:38.369943 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.369919 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.372809 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.372779 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5pp4t\"" Jul 07 14:57:38.372908 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.372807 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:57:38.372908 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.372781 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:57:38.564008 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.563888 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae755654-5d8b-48e4-a729-9e3842df2034-data-volume\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.564008 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.563967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.564008 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.563996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmts\" (UniqueName: \"kubernetes.io/projected/ae755654-5d8b-48e4-a729-9e3842df2034-kube-api-access-xwmts\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.564257 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.564082 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae755654-5d8b-48e4-a729-9e3842df2034-crio-socket\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.564257 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.564177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.665080 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.665036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae755654-5d8b-48e4-a729-9e3842df2034-crio-socket\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.665227 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.665119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.665227 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.665177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae755654-5d8b-48e4-a729-9e3842df2034-data-volume\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.665227 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.665201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.665403 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.665230 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmts\" (UniqueName: \"kubernetes.io/projected/ae755654-5d8b-48e4-a729-9e3842df2034-kube-api-access-xwmts\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.665403 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:38.665258 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:38.665403 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.665272 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae755654-5d8b-48e4-a729-9e3842df2034-crio-socket\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.665403 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:38.665345 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:39.165323895 +0000 UTC m=+47.889225714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : configmap "kube-rbac-proxy" not found Jul 07 14:57:38.665403 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:38.665389 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:38.665672 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:38.665476 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:39.165457659 +0000 UTC m=+47.889359465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:38.665672 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.665550 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae755654-5d8b-48e4-a729-9e3842df2034-data-volume\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.674723 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.674695 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmts\" (UniqueName: \"kubernetes.io/projected/ae755654-5d8b-48e4-a729-9e3842df2034-kube-api-access-xwmts\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:38.678660 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.678630 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp"] Jul 07 14:57:38.699149 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.699110 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp"] Jul 07 14:57:38.699269 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.699172 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.701990 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.701967 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 14:57:38.702238 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.701997 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 14:57:38.702238 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.702006 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:57:38.702431 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.702336 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 14:57:38.702494 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.702450 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z7g8h\"" Jul 07 14:57:38.867471 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.867390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqkgz\" (UniqueName: \"kubernetes.io/projected/4d6142f6-d100-40e9-83ef-4e83387c7df0-kube-api-access-qqkgz\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.867612 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.867537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d6142f6-d100-40e9-83ef-4e83387c7df0-config\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.867665 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.867603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d6142f6-d100-40e9-83ef-4e83387c7df0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.968583 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.968550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqkgz\" (UniqueName: \"kubernetes.io/projected/4d6142f6-d100-40e9-83ef-4e83387c7df0-kube-api-access-qqkgz\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.968735 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.968618 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d6142f6-d100-40e9-83ef-4e83387c7df0-config\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.968735 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.968658 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d6142f6-d100-40e9-83ef-4e83387c7df0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.969218 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.969196 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d6142f6-d100-40e9-83ef-4e83387c7df0-config\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.970804 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.970785 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d6142f6-d100-40e9-83ef-4e83387c7df0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:38.976865 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:38.976843 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqkgz\" (UniqueName: \"kubernetes.io/projected/4d6142f6-d100-40e9-83ef-4e83387c7df0-kube-api-access-qqkgz\") pod \"service-ca-operator-5d46d9ffd4-mswfp\" (UID: \"4d6142f6-d100-40e9-83ef-4e83387c7df0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:39.010498 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.010466 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" Jul 07 14:57:39.144500 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.144471 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp"] Jul 07 14:57:39.170873 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.170847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:39.170993 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.170959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:39.170993 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:39.170977 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:39.171117 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:39.171032 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:39.171117 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:39.171054 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:40.171034282 +0000 UTC m=+48.894936093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:39.171117 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:39.171089 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:40.171075901 +0000 UTC m=+48.894977710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : configmap "kube-rbac-proxy" not found Jul 07 14:57:39.259348 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.259326 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 14:57:39.259793 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.259777 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/0.log" Jul 07 14:57:39.259841 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.259816 2582 generic.go:356] "Generic (PLEG): container finished" podID="59e13c22-43a5-483c-8a1b-9ce8c804c107" containerID="c1aa177fa07c13140ef56f8eb6680e1ca23422d385a8d4c63536d294fa494106" exitCode=255 Jul 07 14:57:39.259932 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.259905 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" event={"ID":"59e13c22-43a5-483c-8a1b-9ce8c804c107","Type":"ContainerDied","Data":"c1aa177fa07c13140ef56f8eb6680e1ca23422d385a8d4c63536d294fa494106"} Jul 07 14:57:39.260271 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.259976 2582 scope.go:117] "RemoveContainer" containerID="9f4d2f994ebaa18eff2dea1e3c65124494a514adec32feba7758de67ff147e45" Jul 07 14:57:39.260271 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.260220 2582 scope.go:117] "RemoveContainer" containerID="c1aa177fa07c13140ef56f8eb6680e1ca23422d385a8d4c63536d294fa494106" Jul 07 14:57:39.260434 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:39.260411 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2h9nl_openshift-console-operator(59e13c22-43a5-483c-8a1b-9ce8c804c107)\"" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" podUID="59e13c22-43a5-483c-8a1b-9ce8c804c107" Jul 07 14:57:39.623622 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:39.623539 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6142f6_d100_40e9_83ef_4e83387c7df0.slice/crio-996cb3e96bc8edfcd0dd172052aab6e87a58fc8e4ffcffb474f3f210e9b0a0c4 WatchSource:0}: Error finding container 996cb3e96bc8edfcd0dd172052aab6e87a58fc8e4ffcffb474f3f210e9b0a0c4: Status 404 returned error can't find the container with id 996cb3e96bc8edfcd0dd172052aab6e87a58fc8e4ffcffb474f3f210e9b0a0c4 Jul 07 14:57:39.833431 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.833401 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7"] Jul 07 14:57:39.847567 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.847536 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7"] Jul 07 14:57:39.847675 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.847645 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" Jul 07 14:57:39.851458 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.851438 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r2m8q\"" Jul 07 14:57:39.878547 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.878497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvd2\" (UniqueName: \"kubernetes.io/projected/e4f09655-f9fb-41bb-82da-0c0b09922f88-kube-api-access-4pvd2\") pod \"network-check-source-989f8b8dc-w4xx7\" (UID: \"e4f09655-f9fb-41bb-82da-0c0b09922f88\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" Jul 07 14:57:39.963568 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.963551 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gdr2n_0d6cd7f9-5d3e-4942-ba66-6718a04797ed/dns-node-resolver/0.log" Jul 07 14:57:39.979326 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.979305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvd2\" (UniqueName: \"kubernetes.io/projected/e4f09655-f9fb-41bb-82da-0c0b09922f88-kube-api-access-4pvd2\") pod \"network-check-source-989f8b8dc-w4xx7\" (UID: \"e4f09655-f9fb-41bb-82da-0c0b09922f88\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" Jul 07 14:57:39.990800 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:39.990777 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvd2\" (UniqueName: \"kubernetes.io/projected/e4f09655-f9fb-41bb-82da-0c0b09922f88-kube-api-access-4pvd2\") pod \"network-check-source-989f8b8dc-w4xx7\" (UID: \"e4f09655-f9fb-41bb-82da-0c0b09922f88\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" Jul 07 14:57:40.157621 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.157596 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" Jul 07 14:57:40.181542 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.181483 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:40.181659 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.181557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:40.181726 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:40.181708 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:40.181775 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:40.181768 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:42.181750067 +0000 UTC m=+50.905651866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:40.182036 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:40.181931 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:40.182036 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:40.182001 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:42.181983385 +0000 UTC m=+50.905885180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : configmap "kube-rbac-proxy" not found Jul 07 14:57:40.272431 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.272392 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" event={"ID":"05ac1f53-dadd-4aa7-a572-ef6a13523d30","Type":"ContainerStarted","Data":"35b28d9332b3fb5941747eb2463aa2e3cbdfc96b16b814674fe62ddbf2be8ca4"} Jul 07 14:57:40.278690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.278658 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" event={"ID":"4d6142f6-d100-40e9-83ef-4e83387c7df0","Type":"ContainerStarted","Data":"996cb3e96bc8edfcd0dd172052aab6e87a58fc8e4ffcffb474f3f210e9b0a0c4"} Jul 07 14:57:40.282147 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.282124 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 14:57:40.282464 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.282447 2582 scope.go:117] "RemoveContainer" containerID="c1aa177fa07c13140ef56f8eb6680e1ca23422d385a8d4c63536d294fa494106" Jul 07 14:57:40.282628 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:40.282604 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2h9nl_openshift-console-operator(59e13c22-43a5-483c-8a1b-9ce8c804c107)\"" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" podUID="59e13c22-43a5-483c-8a1b-9ce8c804c107" Jul 07 14:57:40.341439 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.341092 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" podStartSLOduration=1.971637273 podStartE2EDuration="4.341057334s" totalImagesPullingTime="2.369420061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:40.314210443 +0000 UTC m=+49.038112262" watchObservedRunningTime="2026-07-07 14:57:40.341057334 +0000 UTC m=+49.064959155" Jul 07 14:57:40.341975 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:40.341955 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7"] Jul 07 14:57:40.346039 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:40.346008 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f09655_f9fb_41bb_82da_0c0b09922f88.slice/crio-93803400d697e8daf04509a8c6083a7c33c2c309aee5b60a9a79000d75ac8cfc WatchSource:0}: Error finding container 93803400d697e8daf04509a8c6083a7c33c2c309aee5b60a9a79000d75ac8cfc: Status 404 returned error can't find the container with id 93803400d697e8daf04509a8c6083a7c33c2c309aee5b60a9a79000d75ac8cfc Jul 07 14:57:41.185731 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:41.185701 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zzp9g_5df3e50e-b9a9-4128-9af0-13c3c94d04c6/node-ca/0.log" Jul 07 14:57:41.289161 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:41.289101 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" event={"ID":"e4f09655-f9fb-41bb-82da-0c0b09922f88","Type":"ContainerStarted","Data":"93803400d697e8daf04509a8c6083a7c33c2c309aee5b60a9a79000d75ac8cfc"} Jul 07 14:57:41.564039 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:41.563962 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p57rc_b9caa6f1-8fe7-4116-b09f-59f6a24a802f/serve-healthcheck-canary/0.log" Jul 07 14:57:42.201150 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:42.201115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:42.201439 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:42.201218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:42.201439 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.201247 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:57:42.201439 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.201322 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:46.201306946 +0000 UTC m=+54.925208745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : configmap "kube-rbac-proxy" not found Jul 07 14:57:42.201439 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.201395 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:42.201607 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.201461 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:46.201443994 +0000 UTC m=+54.925345790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:42.293700 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:42.293663 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" event={"ID":"4d6142f6-d100-40e9-83ef-4e83387c7df0","Type":"ContainerStarted","Data":"90e2fb0b68626c2f1f84aa766ee78d35656f23b5f7b5675997d19652e61488a0"} Jul 07 14:57:42.320363 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:42.320316 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" podStartSLOduration=2.067496676 podStartE2EDuration="4.320300444s" totalImagesPullingTime="2.252803768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:42.319769446 +0000 UTC m=+51.043671297" watchObservedRunningTime="2026-07-07 14:57:42.320300444 +0000 UTC m=+51.044202255" Jul 07 14:57:42.403473 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:42.403440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:42.403642 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:42.403532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:42.403642 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.403534 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:57:42.403642 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.403613 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls podName:a14c5597-1d75-4ff2-8383-474cbe2efb0e nodeName:}" failed. No retries permitted until 2026-07-07 14:57:58.403595845 +0000 UTC m=+67.127497660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls") pod "dns-default-nxd4t" (UID: "a14c5597-1d75-4ff2-8383-474cbe2efb0e") : secret "dns-default-metrics-tls" not found Jul 07 14:57:42.403806 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.403679 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:57:42.403806 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.403691 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f587d767f-brdpb: secret "image-registry-tls" not found Jul 07 14:57:42.403806 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:42.403723 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls podName:03526a0a-c604-4d13-afe2-3ad062ed91a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:58.403712471 +0000 UTC m=+67.127614268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls") pod "image-registry-6f587d767f-brdpb" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1") : secret "image-registry-tls" not found Jul 07 14:57:44.173394 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:44.173358 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:44.173733 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:44.173417 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:44.173733 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:44.173717 2582 scope.go:117] "RemoveContainer" containerID="c1aa177fa07c13140ef56f8eb6680e1ca23422d385a8d4c63536d294fa494106" Jul 07 14:57:44.173875 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:44.173853 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2h9nl_openshift-console-operator(59e13c22-43a5-483c-8a1b-9ce8c804c107)\"" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" podUID="59e13c22-43a5-483c-8a1b-9ce8c804c107" Jul 07 14:57:44.301744 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:44.301713 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" event={"ID":"e4f09655-f9fb-41bb-82da-0c0b09922f88","Type":"ContainerStarted","Data":"7d8a23d0290fa6f3ae8a00e89b850c51bc42b6f7eee65d455ba13877d0585c27"} Jul 07 14:57:44.322498 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:44.322444 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w4xx7" podStartSLOduration=2.028138991 podStartE2EDuration="5.322426685s" totalImagesPullingTime="3.294287694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:44.321116639 +0000 UTC m=+53.045018459" watchObservedRunningTime="2026-07-07 14:57:44.322426685 +0000 UTC m=+53.046328506" Jul 07 14:57:45.244917 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.244887 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-65hv4"] Jul 07 14:57:45.252498 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.252480 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.255831 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.255808 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-65hv4"] Jul 07 14:57:45.256417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.256136 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 14:57:45.256417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.256141 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 14:57:45.256417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.256142 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 14:57:45.256417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.256280 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 14:57:45.256417 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.256411 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-chtgn\"" Jul 07 14:57:45.327694 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.327672 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btz8j\" (UniqueName: \"kubernetes.io/projected/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-kube-api-access-btz8j\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.327800 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.327751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-signing-key\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.327800 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.327791 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-signing-cabundle\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.428292 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.428260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-signing-key\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.428399 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.428305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-signing-cabundle\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.428399 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.428364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btz8j\" (UniqueName: \"kubernetes.io/projected/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-kube-api-access-btz8j\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.429044 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.429028 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-signing-cabundle\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.430606 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.430583 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-signing-key\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.441813 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.441796 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btz8j\" (UniqueName: \"kubernetes.io/projected/a138ffbd-9382-4c34-ae10-c02a4bdb6c47-kube-api-access-btz8j\") pod \"service-ca-758f599c5-65hv4\" (UID: \"a138ffbd-9382-4c34-ae10-c02a4bdb6c47\") " pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.561490 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.561439 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-65hv4" Jul 07 14:57:45.677591 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:45.677561 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-65hv4"] Jul 07 14:57:45.681335 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:45.681308 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda138ffbd_9382_4c34_ae10_c02a4bdb6c47.slice/crio-fec0e846f31b6df369b65f0af17f62d92bf8dc985649cf7f3bcdfe54bff3349a WatchSource:0}: Error finding container fec0e846f31b6df369b65f0af17f62d92bf8dc985649cf7f3bcdfe54bff3349a: Status 404 returned error can't find the container with id fec0e846f31b6df369b65f0af17f62d92bf8dc985649cf7f3bcdfe54bff3349a Jul 07 14:57:46.234979 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:46.234947 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:46.235227 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:46.235088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:46.235227 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:46.235107 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:57:46.235227 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:57:46.235166 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls podName:ae755654-5d8b-48e4-a729-9e3842df2034 nodeName:}" failed. No retries permitted until 2026-07-07 14:57:54.23514976 +0000 UTC m=+62.959051556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jn94p" (UID: "ae755654-5d8b-48e4-a729-9e3842df2034") : secret "insights-runtime-extractor-tls" not found Jul 07 14:57:46.235659 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:46.235641 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae755654-5d8b-48e4-a729-9e3842df2034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:46.309661 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:46.309631 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-65hv4" event={"ID":"a138ffbd-9382-4c34-ae10-c02a4bdb6c47","Type":"ContainerStarted","Data":"b1c5a2ce2c9036295efa45c8cf2a749253dc9403ea8aa2003dcf08f391aeedda"} Jul 07 14:57:46.310098 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:46.309678 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-65hv4" event={"ID":"a138ffbd-9382-4c34-ae10-c02a4bdb6c47","Type":"ContainerStarted","Data":"fec0e846f31b6df369b65f0af17f62d92bf8dc985649cf7f3bcdfe54bff3349a"} Jul 07 14:57:46.326857 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:46.326815 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-65hv4" podStartSLOduration=1.326801447 podStartE2EDuration="1.326801447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:46.326134325 +0000 UTC m=+55.050036143" watchObservedRunningTime="2026-07-07 14:57:46.326801447 +0000 UTC m=+55.050703290" Jul 07 14:57:54.207929 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:54.207899 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nq8wm" Jul 07 14:57:54.303300 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:54.303265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:54.305545 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:54.305519 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae755654-5d8b-48e4-a729-9e3842df2034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jn94p\" (UID: \"ae755654-5d8b-48e4-a729-9e3842df2034\") " pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:54.583829 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:54.583760 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5pp4t\"" Jul 07 14:57:54.591160 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:54.591142 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jn94p" Jul 07 14:57:54.725465 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:54.725437 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jn94p"] Jul 07 14:57:54.727052 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:54.727029 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae755654_5d8b_48e4_a729_9e3842df2034.slice/crio-26a31a0bbf2d8fbf780256a2e669ba8a51bfd86dee78bc51cfbf5b23d6f3d22c WatchSource:0}: Error finding container 26a31a0bbf2d8fbf780256a2e669ba8a51bfd86dee78bc51cfbf5b23d6f3d22c: Status 404 returned error can't find the container with id 26a31a0bbf2d8fbf780256a2e669ba8a51bfd86dee78bc51cfbf5b23d6f3d22c Jul 07 14:57:55.340632 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:55.340594 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn94p" event={"ID":"ae755654-5d8b-48e4-a729-9e3842df2034","Type":"ContainerStarted","Data":"26a31a0bbf2d8fbf780256a2e669ba8a51bfd86dee78bc51cfbf5b23d6f3d22c"} Jul 07 14:57:56.985600 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:56.985568 2582 scope.go:117] "RemoveContainer" containerID="c1aa177fa07c13140ef56f8eb6680e1ca23422d385a8d4c63536d294fa494106" Jul 07 14:57:57.529541 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.529515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:57.529708 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.529555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:57.538364 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.538344 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:57:57.541955 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.541931 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:57:57.542215 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.542196 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b611955-d7ce-493b-8d46-dcf31815c4bc-original-pull-secret\") pod \"global-pull-secret-syncer-mnjnx\" (UID: \"2b611955-d7ce-493b-8d46-dcf31815c4bc\") " pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:57.551666 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.551646 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b10826e0-c841-4537-a855-18fd4d6ba933-metrics-certs\") pod \"network-metrics-daemon-jhpg5\" (UID: \"b10826e0-c841-4537-a855-18fd4d6ba933\") " pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:57.704812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.704782 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4xq58\"" Jul 07 14:57:57.711485 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.711463 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhpg5" Jul 07 14:57:57.713771 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.713749 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnjnx" Jul 07 14:57:57.731755 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.731732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:57.734481 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:57.734457 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvj84\" (UniqueName: \"kubernetes.io/projected/596f38b8-78a0-4915-bf9f-f8caed7e4238-kube-api-access-nvj84\") pod \"network-check-target-q8n52\" (UID: \"596f38b8-78a0-4915-bf9f-f8caed7e4238\") " pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:58.010886 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.010853 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb9sm\"" Jul 07 14:57:58.018490 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.018467 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:58.437389 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.437360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:58.437571 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.437414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:58.439690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.439665 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"image-registry-6f587d767f-brdpb\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:58.439789 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.439675 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a14c5597-1d75-4ff2-8383-474cbe2efb0e-metrics-tls\") pod \"dns-default-nxd4t\" (UID: \"a14c5597-1d75-4ff2-8383-474cbe2efb0e\") " pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:58.618113 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.618083 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dqrsp\"" Jul 07 14:57:58.623690 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.623528 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:58.635574 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.635505 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jkfb7\"" Jul 07 14:57:58.640628 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.640562 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nxd4t" Jul 07 14:57:58.655695 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.655667 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnjnx"] Jul 07 14:57:58.662567 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.662546 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jhpg5"] Jul 07 14:57:58.680214 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:58.680192 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q8n52"] Jul 07 14:57:58.833889 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:58.833810 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b611955_d7ce_493b_8d46_dcf31815c4bc.slice/crio-5c3418f874cfd593194318e4cfa15220389a18e22fc8a6f86c85d727c5da5820 WatchSource:0}: Error finding container 5c3418f874cfd593194318e4cfa15220389a18e22fc8a6f86c85d727c5da5820: Status 404 returned error can't find the container with id 5c3418f874cfd593194318e4cfa15220389a18e22fc8a6f86c85d727c5da5820 Jul 07 14:57:58.834664 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:58.834626 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10826e0_c841_4537_a855_18fd4d6ba933.slice/crio-8765874d34e9e332ad9cf78b04bb03779b98c50cb531493e0c12b3206dcacc77 WatchSource:0}: Error finding container 8765874d34e9e332ad9cf78b04bb03779b98c50cb531493e0c12b3206dcacc77: Status 404 returned error can't find the container with id 8765874d34e9e332ad9cf78b04bb03779b98c50cb531493e0c12b3206dcacc77 Jul 07 14:57:58.836426 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:58.836375 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596f38b8_78a0_4915_bf9f_f8caed7e4238.slice/crio-3472d06aebcd2871d41448156afcdb58241de06dd2cbb60320af37ca83a22dc9 WatchSource:0}: Error finding container 3472d06aebcd2871d41448156afcdb58241de06dd2cbb60320af37ca83a22dc9: Status 404 returned error can't find the container with id 3472d06aebcd2871d41448156afcdb58241de06dd2cbb60320af37ca83a22dc9 Jul 07 14:57:59.019470 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.019446 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f587d767f-brdpb"] Jul 07 14:57:59.022307 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:59.022283 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03526a0a_c604_4d13_afe2_3ad062ed91a1.slice/crio-0fbb2a8e8bbd95434374d107685d4fc7bb2f82ca25aab0aa4f108a4c6e4fe828 WatchSource:0}: Error finding container 0fbb2a8e8bbd95434374d107685d4fc7bb2f82ca25aab0aa4f108a4c6e4fe828: Status 404 returned error can't find the container with id 0fbb2a8e8bbd95434374d107685d4fc7bb2f82ca25aab0aa4f108a4c6e4fe828 Jul 07 14:57:59.031931 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.031909 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nxd4t"] Jul 07 14:57:59.034527 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:57:59.034473 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14c5597_1d75_4ff2_8383_474cbe2efb0e.slice/crio-8623e833ec6d5b365d1cb1b8a50ffe11e8da604338d397e0ebeb4c08f0bf3776 WatchSource:0}: Error finding container 8623e833ec6d5b365d1cb1b8a50ffe11e8da604338d397e0ebeb4c08f0bf3776: Status 404 returned error can't find the container with id 8623e833ec6d5b365d1cb1b8a50ffe11e8da604338d397e0ebeb4c08f0bf3776 Jul 07 14:57:59.359018 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.358935 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" event={"ID":"03526a0a-c604-4d13-afe2-3ad062ed91a1","Type":"ContainerStarted","Data":"24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65"} Jul 07 14:57:59.359018 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.358999 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" event={"ID":"03526a0a-c604-4d13-afe2-3ad062ed91a1","Type":"ContainerStarted","Data":"0fbb2a8e8bbd95434374d107685d4fc7bb2f82ca25aab0aa4f108a4c6e4fe828"} Jul 07 14:57:59.359243 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.359077 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:57:59.360825 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.360799 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnjnx" event={"ID":"2b611955-d7ce-493b-8d46-dcf31815c4bc","Type":"ContainerStarted","Data":"5c3418f874cfd593194318e4cfa15220389a18e22fc8a6f86c85d727c5da5820"} Jul 07 14:57:59.362795 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.362760 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn94p" event={"ID":"ae755654-5d8b-48e4-a729-9e3842df2034","Type":"ContainerStarted","Data":"bc4e75d24c4fa86e08fbf090fd02a0245f4a25ded25e6a0f4f13e4f8938de4a3"} Jul 07 14:57:59.364197 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.364145 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhpg5" event={"ID":"b10826e0-c841-4537-a855-18fd4d6ba933","Type":"ContainerStarted","Data":"8765874d34e9e332ad9cf78b04bb03779b98c50cb531493e0c12b3206dcacc77"} Jul 07 14:57:59.366444 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.366422 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 14:57:59.366444 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.366513 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" event={"ID":"59e13c22-43a5-483c-8a1b-9ce8c804c107","Type":"ContainerStarted","Data":"569a39b66991ad8501004d13346723f6b81829ecab197e2a41bec052741aec09"} Jul 07 14:57:59.367119 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.367101 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:59.368189 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.368119 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nxd4t" event={"ID":"a14c5597-1d75-4ff2-8383-474cbe2efb0e","Type":"ContainerStarted","Data":"8623e833ec6d5b365d1cb1b8a50ffe11e8da604338d397e0ebeb4c08f0bf3776"} Jul 07 14:57:59.371534 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.371343 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q8n52" event={"ID":"596f38b8-78a0-4915-bf9f-f8caed7e4238","Type":"ContainerStarted","Data":"8ed0c66ce0a7f010c70eec77dffabb93e7642fb91c1ade0ffd007f8c9e3f2b68"} Jul 07 14:57:59.371534 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.371411 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q8n52" event={"ID":"596f38b8-78a0-4915-bf9f-f8caed7e4238","Type":"ContainerStarted","Data":"3472d06aebcd2871d41448156afcdb58241de06dd2cbb60320af37ca83a22dc9"} Jul 07 14:57:59.371770 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.371732 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:57:59.372760 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.372739 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" Jul 07 14:57:59.384502 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.384446 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" podStartSLOduration=67.384408111 podStartE2EDuration="1m7.384408111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:59.384371597 +0000 UTC m=+68.108273414" watchObservedRunningTime="2026-07-07 14:57:59.384408111 +0000 UTC m=+68.108309931" Jul 07 14:57:59.408811 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.408552 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q8n52" podStartSLOduration=67.408533508 podStartE2EDuration="1m7.408533508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:59.406608818 +0000 UTC m=+68.130510635" watchObservedRunningTime="2026-07-07 14:57:59.408533508 +0000 UTC m=+68.132435318" Jul 07 14:57:59.429104 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:57:59.429039 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-2h9nl" podStartSLOduration=23.325464321 podStartE2EDuration="26.429025203s" totalImagesPullingTime="3.103560882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:57:59.427299988 +0000 UTC m=+68.151201807" watchObservedRunningTime="2026-07-07 14:57:59.429025203 +0000 UTC m=+68.152927022" Jul 07 14:58:00.377599 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:00.377567 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn94p" event={"ID":"ae755654-5d8b-48e4-a729-9e3842df2034","Type":"ContainerStarted","Data":"142482a607bd4ac6bb1afb2e8811b44141172720f40f89f8d88b8823eeb972ab"} Jul 07 14:58:00.379595 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:00.379560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhpg5" event={"ID":"b10826e0-c841-4537-a855-18fd4d6ba933","Type":"ContainerStarted","Data":"9add377bd19cce9c6d671174abc3666e4a1543f14c65923e71e188a2c2128e67"} Jul 07 14:58:01.388486 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:01.388408 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhpg5" event={"ID":"b10826e0-c841-4537-a855-18fd4d6ba933","Type":"ContainerStarted","Data":"e98c5717315d7e561fd8e707e904594d95e9499382aa6edca1333df5ad4ec489"} Jul 07 14:58:01.411349 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:01.411289 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jhpg5" podStartSLOduration=68.028545793 podStartE2EDuration="1m9.411236651s" totalImagesPullingTime="1.382690858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:01.408365255 +0000 UTC m=+70.132267086" watchObservedRunningTime="2026-07-07 14:58:01.411236651 +0000 UTC m=+70.135138470" Jul 07 14:58:04.402684 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:04.402496 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnjnx" event={"ID":"2b611955-d7ce-493b-8d46-dcf31815c4bc","Type":"ContainerStarted","Data":"35aa48337a7dc83a9d3402a312b7c7bc3a7ff68a9db36907e61d786094742e9b"} Jul 07 14:58:04.405083 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:04.405045 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jn94p" event={"ID":"ae755654-5d8b-48e4-a729-9e3842df2034","Type":"ContainerStarted","Data":"c4b87a2377210a18f0041c147b08e581e2310b5ab1c9cb5de1cc254a6d31c725"} Jul 07 14:58:04.406671 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:04.406643 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nxd4t" event={"ID":"a14c5597-1d75-4ff2-8383-474cbe2efb0e","Type":"ContainerStarted","Data":"44872f60f3abf046554477ab398e10f60e58d5536d83138f20cdf7590ea2a139"} Jul 07 14:58:04.420165 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:04.420109 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mnjnx" podStartSLOduration=67.036295299 podStartE2EDuration="1m12.420094253s" totalImagesPullingTime="5.383798954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:04.41909038 +0000 UTC m=+73.142992195" watchObservedRunningTime="2026-07-07 14:58:04.420094253 +0000 UTC m=+73.143996072" Jul 07 14:58:05.412018 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:05.411978 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nxd4t" event={"ID":"a14c5597-1d75-4ff2-8383-474cbe2efb0e","Type":"ContainerStarted","Data":"14db77a163079b42a248593cb5809ef2a25ad643943e235d66799690af190b4b"} Jul 07 14:58:05.434041 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:05.433983 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nxd4t" podStartSLOduration=34.234996794 podStartE2EDuration="39.433964077s" totalImagesPullingTime="5.198967283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:05.433345549 +0000 UTC m=+74.157247367" watchObservedRunningTime="2026-07-07 14:58:05.433964077 +0000 UTC m=+74.157865896" Jul 07 14:58:05.434251 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:05.434219 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jn94p" podStartSLOduration=18.216365158 podStartE2EDuration="27.434209494s" totalImagesPullingTime="9.217844336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:57:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:04.442153792 +0000 UTC m=+73.166055611" watchObservedRunningTime="2026-07-07 14:58:05.434209494 +0000 UTC m=+74.158111311" Jul 07 14:58:06.415557 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.415527 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nxd4t" Jul 07 14:58:06.915271 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.915235 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx"] Jul 07 14:58:06.929007 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.928979 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qchp5"] Jul 07 14:58:06.929160 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.929103 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:06.940702 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.940687 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 14:58:06.940835 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.940819 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:06.942389 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.942363 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 14:58:06.942504 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.942429 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 14:58:06.942504 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.942486 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 14:58:06.942632 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.942620 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9jf5d\"" Jul 07 14:58:06.943895 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.943874 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 14:58:06.944037 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.944023 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx"] Jul 07 14:58:06.944134 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.944116 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9klz4\"" Jul 07 14:58:06.944634 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.944615 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 14:58:06.945299 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.945284 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qchp5"] Jul 07 14:58:06.979307 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:06.979278 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-rmvds"] Jul 07 14:58:07.001854 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.001827 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rmvds"] Jul 07 14:58:07.001956 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.001923 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rmvds" Jul 07 14:58:07.006713 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.006685 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:58:07.009654 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.009370 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:58:07.009834 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.009813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f9f2e6e-688b-4660-b5b8-77b9c45b6079-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b65b6bc96-h6lmx\" (UID: \"2f9f2e6e-688b-4660-b5b8-77b9c45b6079\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:07.009905 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.009849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/23a0759d-c277-45bd-83af-c9c1c6a4d439-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qchp5\" (UID: \"23a0759d-c277-45bd-83af-c9c1c6a4d439\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:07.009905 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.009879 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23a0759d-c277-45bd-83af-c9c1c6a4d439-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qchp5\" (UID: \"23a0759d-c277-45bd-83af-c9c1c6a4d439\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:07.010017 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.010000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5cqnq\"" Jul 07 14:58:07.010017 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.009996 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgss5\" (UniqueName: \"kubernetes.io/projected/2f9f2e6e-688b-4660-b5b8-77b9c45b6079-kube-api-access-mgss5\") pod \"managed-serviceaccount-addon-agent-b65b6bc96-h6lmx\" (UID: \"2f9f2e6e-688b-4660-b5b8-77b9c45b6079\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:07.110502 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.110476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgss5\" (UniqueName: \"kubernetes.io/projected/2f9f2e6e-688b-4660-b5b8-77b9c45b6079-kube-api-access-mgss5\") pod \"managed-serviceaccount-addon-agent-b65b6bc96-h6lmx\" (UID: \"2f9f2e6e-688b-4660-b5b8-77b9c45b6079\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:07.110601 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.110527 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f9f2e6e-688b-4660-b5b8-77b9c45b6079-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b65b6bc96-h6lmx\" (UID: \"2f9f2e6e-688b-4660-b5b8-77b9c45b6079\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:07.110601 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.110555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/23a0759d-c277-45bd-83af-c9c1c6a4d439-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qchp5\" (UID: \"23a0759d-c277-45bd-83af-c9c1c6a4d439\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:07.110601 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.110591 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lv7c\" (UniqueName: \"kubernetes.io/projected/fce1f29a-9371-4b49-a0de-93df46c6a4e3-kube-api-access-6lv7c\") pod \"downloads-685bfb5f64-rmvds\" (UID: \"fce1f29a-9371-4b49-a0de-93df46c6a4e3\") " pod="openshift-console/downloads-685bfb5f64-rmvds" Jul 07 14:58:07.110731 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.110618 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23a0759d-c277-45bd-83af-c9c1c6a4d439-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qchp5\" (UID: \"23a0759d-c277-45bd-83af-c9c1c6a4d439\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:07.111334 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.111314 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23a0759d-c277-45bd-83af-c9c1c6a4d439-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qchp5\" (UID: \"23a0759d-c277-45bd-83af-c9c1c6a4d439\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:07.112910 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.112890 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/23a0759d-c277-45bd-83af-c9c1c6a4d439-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qchp5\" (UID: \"23a0759d-c277-45bd-83af-c9c1c6a4d439\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:07.112984 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.112963 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2f9f2e6e-688b-4660-b5b8-77b9c45b6079-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b65b6bc96-h6lmx\" (UID: \"2f9f2e6e-688b-4660-b5b8-77b9c45b6079\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:07.127356 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.127337 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgss5\" (UniqueName: \"kubernetes.io/projected/2f9f2e6e-688b-4660-b5b8-77b9c45b6079-kube-api-access-mgss5\") pod \"managed-serviceaccount-addon-agent-b65b6bc96-h6lmx\" (UID: \"2f9f2e6e-688b-4660-b5b8-77b9c45b6079\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:07.211921 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.211863 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lv7c\" (UniqueName: \"kubernetes.io/projected/fce1f29a-9371-4b49-a0de-93df46c6a4e3-kube-api-access-6lv7c\") pod \"downloads-685bfb5f64-rmvds\" (UID: \"fce1f29a-9371-4b49-a0de-93df46c6a4e3\") " pod="openshift-console/downloads-685bfb5f64-rmvds" Jul 07 14:58:07.227055 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.227028 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lv7c\" (UniqueName: \"kubernetes.io/projected/fce1f29a-9371-4b49-a0de-93df46c6a4e3-kube-api-access-6lv7c\") pod \"downloads-685bfb5f64-rmvds\" (UID: \"fce1f29a-9371-4b49-a0de-93df46c6a4e3\") " pod="openshift-console/downloads-685bfb5f64-rmvds" Jul 07 14:58:07.248935 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.248916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" Jul 07 14:58:07.259033 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.259014 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" Jul 07 14:58:07.311794 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.311766 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rmvds" Jul 07 14:58:07.422663 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.422534 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx"] Jul 07 14:58:07.425520 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:58:07.425492 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f9f2e6e_688b_4660_b5b8_77b9c45b6079.slice/crio-a42ecfa43e6d4f0b000368da8c6297f097aca7f81fb17d0a869635847d251d2c WatchSource:0}: Error finding container a42ecfa43e6d4f0b000368da8c6297f097aca7f81fb17d0a869635847d251d2c: Status 404 returned error can't find the container with id a42ecfa43e6d4f0b000368da8c6297f097aca7f81fb17d0a869635847d251d2c Jul 07 14:58:07.443794 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:58:07.443759 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a0759d_c277_45bd_83af_c9c1c6a4d439.slice/crio-9bea951073211670dd1d353df611a3b4eb1c4ec7cb9dabc695a2a3bb69e83817 WatchSource:0}: Error finding container 9bea951073211670dd1d353df611a3b4eb1c4ec7cb9dabc695a2a3bb69e83817: Status 404 returned error can't find the container with id 9bea951073211670dd1d353df611a3b4eb1c4ec7cb9dabc695a2a3bb69e83817 Jul 07 14:58:07.445220 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.445199 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qchp5"] Jul 07 14:58:07.495169 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:07.495148 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rmvds"] Jul 07 14:58:07.497076 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:58:07.497031 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce1f29a_9371_4b49_a0de_93df46c6a4e3.slice/crio-d2c140c3e316675f45ffede0e2329e201a1b0819085d60171b5c1d4d52480c7d WatchSource:0}: Error finding container d2c140c3e316675f45ffede0e2329e201a1b0819085d60171b5c1d4d52480c7d: Status 404 returned error can't find the container with id d2c140c3e316675f45ffede0e2329e201a1b0819085d60171b5c1d4d52480c7d Jul 07 14:58:08.140761 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.140721 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff8c54cc7-wbrgx"] Jul 07 14:58:08.143031 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.143006 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.146300 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.146135 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:58:08.149087 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.148535 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:58:08.151052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.149802 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:58:08.151052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.150036 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r9f7h\"" Jul 07 14:58:08.151052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.150584 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:58:08.151052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.150751 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:58:08.158116 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.158046 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff8c54cc7-wbrgx"] Jul 07 14:58:08.218348 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.218193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-serving-cert\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.218348 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.218281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-oauth-config\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.218348 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.218310 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-service-ca\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.218627 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.218372 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-oauth-serving-cert\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.218627 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.218398 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-console-config\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.218627 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.218433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm4rv\" (UniqueName: \"kubernetes.io/projected/0ddef53a-c82e-449f-bc84-9f9299098651-kube-api-access-mm4rv\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.318852 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.318813 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm4rv\" (UniqueName: \"kubernetes.io/projected/0ddef53a-c82e-449f-bc84-9f9299098651-kube-api-access-mm4rv\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.319022 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.318873 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-serving-cert\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.319022 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.318939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-oauth-config\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.319022 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.318967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-service-ca\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.319022 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.319000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-oauth-serving-cert\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.319277 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.319025 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-console-config\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.320193 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.319762 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-service-ca\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.321203 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.320735 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-console-config\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.321203 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.321166 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-oauth-serving-cert\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.324490 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.324450 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-oauth-config\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.325128 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.325090 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-serving-cert\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.335878 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.335844 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm4rv\" (UniqueName: \"kubernetes.io/projected/0ddef53a-c82e-449f-bc84-9f9299098651-kube-api-access-mm4rv\") pod \"console-6ff8c54cc7-wbrgx\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:08.427126 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.427003 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rmvds" event={"ID":"fce1f29a-9371-4b49-a0de-93df46c6a4e3","Type":"ContainerStarted","Data":"d2c140c3e316675f45ffede0e2329e201a1b0819085d60171b5c1d4d52480c7d"} Jul 07 14:58:08.429241 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.429165 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" event={"ID":"23a0759d-c277-45bd-83af-c9c1c6a4d439","Type":"ContainerStarted","Data":"9bea951073211670dd1d353df611a3b4eb1c4ec7cb9dabc695a2a3bb69e83817"} Jul 07 14:58:08.431183 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.431135 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" event={"ID":"2f9f2e6e-688b-4660-b5b8-77b9c45b6079","Type":"ContainerStarted","Data":"a42ecfa43e6d4f0b000368da8c6297f097aca7f81fb17d0a869635847d251d2c"} Jul 07 14:58:08.457790 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:08.457726 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:10.085994 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.085920 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff8c54cc7-wbrgx"] Jul 07 14:58:10.089239 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:58:10.089206 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddef53a_c82e_449f_bc84_9f9299098651.slice/crio-3b4ee4f43d00abbf1cd7fa80fabe142d1d59b1d33f55bd03d972aec435a93d8d WatchSource:0}: Error finding container 3b4ee4f43d00abbf1cd7fa80fabe142d1d59b1d33f55bd03d972aec435a93d8d: Status 404 returned error can't find the container with id 3b4ee4f43d00abbf1cd7fa80fabe142d1d59b1d33f55bd03d972aec435a93d8d Jul 07 14:58:10.441551 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.441513 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8c54cc7-wbrgx" event={"ID":"0ddef53a-c82e-449f-bc84-9f9299098651","Type":"ContainerStarted","Data":"3b4ee4f43d00abbf1cd7fa80fabe142d1d59b1d33f55bd03d972aec435a93d8d"} Jul 07 14:58:10.443264 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.443058 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" event={"ID":"23a0759d-c277-45bd-83af-c9c1c6a4d439","Type":"ContainerStarted","Data":"afdfd2b428829d72f3234ad59a5c0debd4a9f92792fdf003541e44cd8c8fb859"} Jul 07 14:58:10.444978 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.444950 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" event={"ID":"2f9f2e6e-688b-4660-b5b8-77b9c45b6079","Type":"ContainerStarted","Data":"7299cc16955f0291ae3e437db9fb23d62ee7db81e7c5be7c4a321cc58ae34d49"} Jul 07 14:58:10.461112 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.461035 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qchp5" podStartSLOduration=1.961630497 podStartE2EDuration="4.461017314s" totalImagesPullingTime="2.499386817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:10.459642489 +0000 UTC m=+79.183544308" watchObservedRunningTime="2026-07-07 14:58:10.461017314 +0000 UTC m=+79.184919134" Jul 07 14:58:10.485130 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.485085 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b65b6bc96-h6lmx" podStartSLOduration=1.935470062 podStartE2EDuration="4.485046063s" totalImagesPullingTime="2.549576001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:10.482477054 +0000 UTC m=+79.206378873" watchObservedRunningTime="2026-07-07 14:58:10.485046063 +0000 UTC m=+79.208947938" Jul 07 14:58:10.499570 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.499361 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fc84d667f-7dfw8"] Jul 07 14:58:10.502488 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.502470 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.512430 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.512404 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:58:10.523979 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.523863 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc84d667f-7dfw8"] Jul 07 14:58:10.636687 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.636650 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-trusted-ca-bundle\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.636867 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.636700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-oauth-serving-cert\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.636867 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.636760 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-config\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.636867 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.636786 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfdpv\" (UniqueName: \"kubernetes.io/projected/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-kube-api-access-kfdpv\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.637671 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.636816 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-serving-cert\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.637772 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.637757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-service-ca\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.637842 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.637787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-oauth-config\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.738984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-trusted-ca-bundle\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739019 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-oauth-serving-cert\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739052 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-config\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739291 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfdpv\" (UniqueName: \"kubernetes.io/projected/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-kube-api-access-kfdpv\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739291 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-serving-cert\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739291 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-service-ca\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739291 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-oauth-config\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739762 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739736 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-config\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.739906 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739880 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-oauth-serving-cert\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.740000 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.739986 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-trusted-ca-bundle\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.740033 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.740005 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-service-ca\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.741591 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.741572 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-oauth-config\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.741591 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.741583 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-serving-cert\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.748344 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.748322 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfdpv\" (UniqueName: \"kubernetes.io/projected/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-kube-api-access-kfdpv\") pod \"console-5fc84d667f-7dfw8\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.814469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.814236 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:10.970393 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:10.970325 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc84d667f-7dfw8"] Jul 07 14:58:10.973038 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:58:10.973013 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2328f29_ec0b_42c4_9e23_a3bf0c9263dd.slice/crio-cd9b502e97949fd0893224275df1dbbb336812aee85bcd3b6e740d38a9558c6d WatchSource:0}: Error finding container cd9b502e97949fd0893224275df1dbbb336812aee85bcd3b6e740d38a9558c6d: Status 404 returned error can't find the container with id cd9b502e97949fd0893224275df1dbbb336812aee85bcd3b6e740d38a9558c6d Jul 07 14:58:11.452414 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:11.452372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc84d667f-7dfw8" event={"ID":"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd","Type":"ContainerStarted","Data":"cd9b502e97949fd0893224275df1dbbb336812aee85bcd3b6e740d38a9558c6d"} Jul 07 14:58:14.471520 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:14.471485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc84d667f-7dfw8" event={"ID":"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd","Type":"ContainerStarted","Data":"21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf"} Jul 07 14:58:14.472977 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:14.472953 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8c54cc7-wbrgx" event={"ID":"0ddef53a-c82e-449f-bc84-9f9299098651","Type":"ContainerStarted","Data":"17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372"} Jul 07 14:58:14.493422 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:14.493380 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fc84d667f-7dfw8" podStartSLOduration=1.410787731 podStartE2EDuration="4.493368171s" totalImagesPullingTime="3.08258044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:14.492698328 +0000 UTC m=+83.216600148" watchObservedRunningTime="2026-07-07 14:58:14.493368171 +0000 UTC m=+83.217269990" Jul 07 14:58:14.517024 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:14.516978 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ff8c54cc7-wbrgx" podStartSLOduration=2.556890251 podStartE2EDuration="6.516963051s" totalImagesPullingTime="3.9600728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:14.516239614 +0000 UTC m=+83.240141435" watchObservedRunningTime="2026-07-07 14:58:14.516963051 +0000 UTC m=+83.240864869" Jul 07 14:58:16.422581 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:16.422552 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nxd4t" Jul 07 14:58:18.458833 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:18.458799 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:18.459304 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:18.458903 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:18.460247 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:18.460217 2582 patch_prober.go:28] interesting pod/console-6ff8c54cc7-wbrgx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jul 07 14:58:18.460390 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:18.460271 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6ff8c54cc7-wbrgx" podUID="0ddef53a-c82e-449f-bc84-9f9299098651" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jul 07 14:58:18.629661 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:18.629615 2582 patch_prober.go:28] interesting pod/image-registry-6f587d767f-brdpb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 14:58:18.629812 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:18.629673 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" podUID="03526a0a-c604-4d13-afe2-3ad062ed91a1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:58:20.384356 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:20.384325 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:58:20.814924 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:20.814889 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:20.815114 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:20.814955 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:20.819963 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:20.819939 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:21.509354 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:21.509326 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:58:21.566276 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:21.566209 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff8c54cc7-wbrgx"] Jul 07 14:58:24.956191 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:24.956155 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bzx5j"] Jul 07 14:58:25.101051 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.101011 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.104495 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.104468 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:58:25.104642 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.104518 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:58:25.104813 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.104763 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:58:25.105597 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.105398 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:58:25.105597 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.105447 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:58:25.105597 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.105466 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:58:25.105833 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.105815 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wp8w\"" Jul 07 14:58:25.265196 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-metrics-client-ca\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265196 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265184 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265229 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-sys\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-root\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265333 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-textfile\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265385 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cdqp\" (UniqueName: \"kubernetes.io/projected/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-kube-api-access-8cdqp\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.265429 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.265415 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-wtmp\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366434 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-sys\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-root\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-textfile\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366506 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-sys\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366598 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366569 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-root\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:58:25.366602 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:58:25.366670 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls podName:218fe3c8-053f-4fb7-9d67-59b6e4c2b634 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:25.866647548 +0000 UTC m=+94.590549352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls") pod "node-exporter-bzx5j" (UID: "218fe3c8-053f-4fb7-9d67-59b6e4c2b634") : secret "node-exporter-tls" not found Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366690 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cdqp\" (UniqueName: \"kubernetes.io/projected/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-kube-api-access-8cdqp\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-wtmp\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-metrics-client-ca\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.366850 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366844 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-textfile\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.367261 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.366997 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-wtmp\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.367538 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.367518 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-metrics-client-ca\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.367641 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.367542 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.369434 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.369408 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.378865 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.378841 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cdqp\" (UniqueName: \"kubernetes.io/projected/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-kube-api-access-8cdqp\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.872912 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:25.872854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:25.873166 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:58:25.873094 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 14:58:25.873265 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:58:25.873172 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls podName:218fe3c8-053f-4fb7-9d67-59b6e4c2b634 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:26.87314867 +0000 UTC m=+95.597050469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls") pod "node-exporter-bzx5j" (UID: "218fe3c8-053f-4fb7-9d67-59b6e4c2b634") : secret "node-exporter-tls" not found Jul 07 14:58:26.882349 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:26.882317 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:26.884495 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:26.884466 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/218fe3c8-053f-4fb7-9d67-59b6e4c2b634-node-exporter-tls\") pod \"node-exporter-bzx5j\" (UID: \"218fe3c8-053f-4fb7-9d67-59b6e4c2b634\") " pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:26.913457 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:26.913432 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzx5j" Jul 07 14:58:27.013018 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:58:27.012993 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218fe3c8_053f_4fb7_9d67_59b6e4c2b634.slice/crio-124347640a75c3a0def5dfc90ce6659cf41db8e9c4ed72dc48224f5b95f31521 WatchSource:0}: Error finding container 124347640a75c3a0def5dfc90ce6659cf41db8e9c4ed72dc48224f5b95f31521: Status 404 returned error can't find the container with id 124347640a75c3a0def5dfc90ce6659cf41db8e9c4ed72dc48224f5b95f31521 Jul 07 14:58:27.531311 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:27.531167 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzx5j" event={"ID":"218fe3c8-053f-4fb7-9d67-59b6e4c2b634","Type":"ContainerStarted","Data":"124347640a75c3a0def5dfc90ce6659cf41db8e9c4ed72dc48224f5b95f31521"} Jul 07 14:58:27.533432 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:27.533397 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rmvds" event={"ID":"fce1f29a-9371-4b49-a0de-93df46c6a4e3","Type":"ContainerStarted","Data":"72cedefb549196a457bb3492f8c972084b4908e804d82cc8d78337001c5633d3"} Jul 07 14:58:27.534513 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:27.534448 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-rmvds" Jul 07 14:58:27.547755 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:27.547728 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-rmvds" Jul 07 14:58:27.558302 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:27.558142 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-rmvds" podStartSLOduration=2.001617988 podStartE2EDuration="21.558123881s" totalImagesPullingTime="19.556505893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:27.556604683 +0000 UTC m=+96.280506492" watchObservedRunningTime="2026-07-07 14:58:27.558123881 +0000 UTC m=+96.282025699" Jul 07 14:58:28.544431 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:28.544340 2582 generic.go:356] "Generic (PLEG): container finished" podID="218fe3c8-053f-4fb7-9d67-59b6e4c2b634" containerID="e701c047e7902a3005a398ecddf696198069f5a4e1787ed578ce80c43ea2962e" exitCode=0 Jul 07 14:58:28.544897 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:28.544443 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzx5j" event={"ID":"218fe3c8-053f-4fb7-9d67-59b6e4c2b634","Type":"ContainerDied","Data":"e701c047e7902a3005a398ecddf696198069f5a4e1787ed578ce80c43ea2962e"} Jul 07 14:58:29.552240 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:29.552198 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzx5j" event={"ID":"218fe3c8-053f-4fb7-9d67-59b6e4c2b634","Type":"ContainerStarted","Data":"6a192024e47614a34eafb493ca784fc8a9c16fb5b6211666e78b25d7bb1150e3"} Jul 07 14:58:29.552657 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:29.552267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzx5j" event={"ID":"218fe3c8-053f-4fb7-9d67-59b6e4c2b634","Type":"ContainerStarted","Data":"122e00ffaa126c77c088aec0507506763b3f37c309b2032d3f54a725fb5217e2"} Jul 07 14:58:29.581814 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:29.581760 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bzx5j" podStartSLOduration=4.484614486 podStartE2EDuration="5.581741582s" totalImagesPullingTime="989.021084ms" totalInitContainerRuntime="108.106012ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:29.581508071 +0000 UTC m=+98.305409891" watchObservedRunningTime="2026-07-07 14:58:29.581741582 +0000 UTC m=+98.305643405" Jul 07 14:58:30.092703 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:30.092669 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f587d767f-brdpb"] Jul 07 14:58:30.381960 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:30.381874 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q8n52" Jul 07 14:58:32.392448 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.392418 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd68cf96b-9lfqr"] Jul 07 14:58:32.433386 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.433352 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd68cf96b-9lfqr"] Jul 07 14:58:32.433536 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.433452 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.530474 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.530437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-oauth-serving-cert\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.530631 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.530482 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jzj6\" (UniqueName: \"kubernetes.io/projected/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-kube-api-access-5jzj6\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.530631 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.530515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-serving-cert\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.530631 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.530564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-config\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.530631 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.530600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-service-ca\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.530631 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.530625 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-trusted-ca-bundle\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.530832 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.530669 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-oauth-config\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.631488 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.631448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-config\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.631662 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.631499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-service-ca\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.631662 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.631529 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-trusted-ca-bundle\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.631662 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.631580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-oauth-config\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.631662 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.631628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-oauth-serving-cert\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.631873 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.631664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jzj6\" (UniqueName: \"kubernetes.io/projected/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-kube-api-access-5jzj6\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.631873 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.631709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-serving-cert\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.632472 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.632427 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-service-ca\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.632768 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.632716 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-oauth-serving-cert\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.633011 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.632972 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-trusted-ca-bundle\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.633121 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.633013 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-config\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.634706 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.634680 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-serving-cert\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.634706 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.634698 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-oauth-config\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.640469 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.640449 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jzj6\" (UniqueName: \"kubernetes.io/projected/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-kube-api-access-5jzj6\") pod \"console-bd68cf96b-9lfqr\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.744402 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.744332 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:32.923994 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:32.923867 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd68cf96b-9lfqr"] Jul 07 14:58:32.927009 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:58:32.926976 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde1df40_f8bc_4e31_8bb4_e0ea96c3f966.slice/crio-ebdfff6433c57c534fa3f45ae6f67e75e398d72f7dcf937f6b820df4efcb89c8 WatchSource:0}: Error finding container ebdfff6433c57c534fa3f45ae6f67e75e398d72f7dcf937f6b820df4efcb89c8: Status 404 returned error can't find the container with id ebdfff6433c57c534fa3f45ae6f67e75e398d72f7dcf937f6b820df4efcb89c8 Jul 07 14:58:33.572380 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:33.572337 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd68cf96b-9lfqr" event={"ID":"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966","Type":"ContainerStarted","Data":"c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4"} Jul 07 14:58:33.572904 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:33.572402 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd68cf96b-9lfqr" event={"ID":"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966","Type":"ContainerStarted","Data":"ebdfff6433c57c534fa3f45ae6f67e75e398d72f7dcf937f6b820df4efcb89c8"} Jul 07 14:58:33.591957 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:33.591907 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd68cf96b-9lfqr" podStartSLOduration=1.591890952 podStartE2EDuration="1.591890952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:33.591322927 +0000 UTC m=+102.315224745" watchObservedRunningTime="2026-07-07 14:58:33.591890952 +0000 UTC m=+102.315792770" Jul 07 14:58:42.745459 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:42.745420 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:42.745935 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:42.745481 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:42.750045 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:42.750022 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:43.615161 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:43.615130 2582 generic.go:356] "Generic (PLEG): container finished" podID="60e1a7f9-f02f-475f-b8a6-73c07aa28ef1" containerID="87b13d4d072757a39b9a1f8125b9be706e701c55b84a1d72090b1a8d1e6a4f48" exitCode=0 Jul 07 14:58:43.615347 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:43.615207 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" event={"ID":"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1","Type":"ContainerDied","Data":"87b13d4d072757a39b9a1f8125b9be706e701c55b84a1d72090b1a8d1e6a4f48"} Jul 07 14:58:43.615693 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:43.615671 2582 scope.go:117] "RemoveContainer" containerID="87b13d4d072757a39b9a1f8125b9be706e701c55b84a1d72090b1a8d1e6a4f48" Jul 07 14:58:43.619325 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:43.619306 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 14:58:43.690636 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:43.690611 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc84d667f-7dfw8"] Jul 07 14:58:44.621450 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:44.621421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-c5q6l" event={"ID":"60e1a7f9-f02f-475f-b8a6-73c07aa28ef1","Type":"ContainerStarted","Data":"e34634979e883a8da818831ba7ba546e502d75affcf059fe2f1ccb84f7d309a9"} Jul 07 14:58:44.716728 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:44.716692 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p57rc_b9caa6f1-8fe7-4116-b09f-59f6a24a802f/serve-healthcheck-canary/0.log" Jul 07 14:58:46.589463 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.589410 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6ff8c54cc7-wbrgx" podUID="0ddef53a-c82e-449f-bc84-9f9299098651" containerName="console" containerID="cri-o://17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372" gracePeriod=15 Jul 07 14:58:46.871608 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.871580 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:46.947391 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947364 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-service-ca\") pod \"0ddef53a-c82e-449f-bc84-9f9299098651\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " Jul 07 14:58:46.947520 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947408 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-console-config\") pod \"0ddef53a-c82e-449f-bc84-9f9299098651\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " Jul 07 14:58:46.947520 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947445 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-oauth-config\") pod \"0ddef53a-c82e-449f-bc84-9f9299098651\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " Jul 07 14:58:46.947520 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947498 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-serving-cert\") pod \"0ddef53a-c82e-449f-bc84-9f9299098651\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " Jul 07 14:58:46.947700 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947532 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm4rv\" (UniqueName: \"kubernetes.io/projected/0ddef53a-c82e-449f-bc84-9f9299098651-kube-api-access-mm4rv\") pod \"0ddef53a-c82e-449f-bc84-9f9299098651\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " Jul 07 14:58:46.947700 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947554 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-oauth-serving-cert\") pod \"0ddef53a-c82e-449f-bc84-9f9299098651\" (UID: \"0ddef53a-c82e-449f-bc84-9f9299098651\") " Jul 07 14:58:46.947875 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947845 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-console-config" (OuterVolumeSpecName: "console-config") pod "0ddef53a-c82e-449f-bc84-9f9299098651" (UID: "0ddef53a-c82e-449f-bc84-9f9299098651"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:58:46.947946 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947877 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ddef53a-c82e-449f-bc84-9f9299098651" (UID: "0ddef53a-c82e-449f-bc84-9f9299098651"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:58:46.947985 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.947939 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ddef53a-c82e-449f-bc84-9f9299098651" (UID: "0ddef53a-c82e-449f-bc84-9f9299098651"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:58:46.949745 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.949723 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ddef53a-c82e-449f-bc84-9f9299098651" (UID: "0ddef53a-c82e-449f-bc84-9f9299098651"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:58:46.949832 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.949765 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ddef53a-c82e-449f-bc84-9f9299098651" (UID: "0ddef53a-c82e-449f-bc84-9f9299098651"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:58:46.949832 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:46.949777 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ddef53a-c82e-449f-bc84-9f9299098651-kube-api-access-mm4rv" (OuterVolumeSpecName: "kube-api-access-mm4rv") pod "0ddef53a-c82e-449f-bc84-9f9299098651" (UID: "0ddef53a-c82e-449f-bc84-9f9299098651"). InnerVolumeSpecName "kube-api-access-mm4rv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:58:47.048396 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.048369 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:47.048396 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.048396 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm4rv\" (UniqueName: \"kubernetes.io/projected/0ddef53a-c82e-449f-bc84-9f9299098651-kube-api-access-mm4rv\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:47.048576 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.048411 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-oauth-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:47.048576 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.048423 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-service-ca\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:47.048576 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.048436 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ddef53a-c82e-449f-bc84-9f9299098651-console-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:47.048576 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.048448 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ddef53a-c82e-449f-bc84-9f9299098651-console-oauth-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:47.633669 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.633641 2582 generic.go:356] "Generic (PLEG): container finished" podID="0ddef53a-c82e-449f-bc84-9f9299098651" containerID="17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372" exitCode=0 Jul 07 14:58:47.634060 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.633682 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff8c54cc7-wbrgx" Jul 07 14:58:47.634060 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.633740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8c54cc7-wbrgx" event={"ID":"0ddef53a-c82e-449f-bc84-9f9299098651","Type":"ContainerDied","Data":"17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372"} Jul 07 14:58:47.634060 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.633794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff8c54cc7-wbrgx" event={"ID":"0ddef53a-c82e-449f-bc84-9f9299098651","Type":"ContainerDied","Data":"3b4ee4f43d00abbf1cd7fa80fabe142d1d59b1d33f55bd03d972aec435a93d8d"} Jul 07 14:58:47.634060 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.633815 2582 scope.go:117] "RemoveContainer" containerID="17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372" Jul 07 14:58:47.642511 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.642495 2582 scope.go:117] "RemoveContainer" containerID="17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372" Jul 07 14:58:47.642758 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:58:47.642738 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372\": container with ID starting with 17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372 not found: ID does not exist" containerID="17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372" Jul 07 14:58:47.642799 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.642767 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372"} err="failed to get container status \"17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372\": rpc error: code = NotFound desc = could not find container \"17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372\": container with ID starting with 17d42ad05fb8092d1ff48daf2f40237416ea7889196ce75711f33722233a6372 not found: ID does not exist" Jul 07 14:58:47.656784 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.656757 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff8c54cc7-wbrgx"] Jul 07 14:58:47.660963 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.660946 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ff8c54cc7-wbrgx"] Jul 07 14:58:47.989220 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:47.989192 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ddef53a-c82e-449f-bc84-9f9299098651" path="/var/lib/kubelet/pods/0ddef53a-c82e-449f-bc84-9f9299098651/volumes" Jul 07 14:58:55.118327 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.118284 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" podUID="03526a0a-c604-4d13-afe2-3ad062ed91a1" containerName="registry" containerID="cri-o://24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65" gracePeriod=30 Jul 07 14:58:55.403183 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.403155 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:58:55.519787 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.519748 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-bound-sa-token\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.519975 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.519804 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-image-registry-private-configuration\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.519975 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.519827 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03526a0a-c604-4d13-afe2-3ad062ed91a1-ca-trust-extracted\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.520105 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.519997 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-certificates\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.520105 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.520057 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mswnb\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-kube-api-access-mswnb\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.520214 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.520121 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-trusted-ca\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.520214 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.520157 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-installation-pull-secrets\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.520214 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.520199 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") pod \"03526a0a-c604-4d13-afe2-3ad062ed91a1\" (UID: \"03526a0a-c604-4d13-afe2-3ad062ed91a1\") " Jul 07 14:58:55.520944 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.520846 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:58:55.521104 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.520992 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:58:55.522449 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.522409 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:58:55.522449 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.522431 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:58:55.522725 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.522683 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-kube-api-access-mswnb" (OuterVolumeSpecName: "kube-api-access-mswnb") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "kube-api-access-mswnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:58:55.522899 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.522876 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:58:55.523076 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.523033 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:58:55.529242 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.529219 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03526a0a-c604-4d13-afe2-3ad062ed91a1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "03526a0a-c604-4d13-afe2-3ad062ed91a1" (UID: "03526a0a-c604-4d13-afe2-3ad062ed91a1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621341 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-bound-sa-token\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621370 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-image-registry-private-configuration\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621380 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03526a0a-c604-4d13-afe2-3ad062ed91a1-ca-trust-extracted\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621389 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-certificates\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621398 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mswnb\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-kube-api-access-mswnb\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621406 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03526a0a-c604-4d13-afe2-3ad062ed91a1-trusted-ca\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621413 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03526a0a-c604-4d13-afe2-3ad062ed91a1-installation-pull-secrets\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.621418 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.621421 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03526a0a-c604-4d13-afe2-3ad062ed91a1-registry-tls\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:58:55.666213 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.666176 2582 generic.go:356] "Generic (PLEG): container finished" podID="03526a0a-c604-4d13-afe2-3ad062ed91a1" containerID="24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65" exitCode=0 Jul 07 14:58:55.666213 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.666216 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" Jul 07 14:58:55.666446 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.666232 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" event={"ID":"03526a0a-c604-4d13-afe2-3ad062ed91a1","Type":"ContainerDied","Data":"24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65"} Jul 07 14:58:55.666446 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.666279 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f587d767f-brdpb" event={"ID":"03526a0a-c604-4d13-afe2-3ad062ed91a1","Type":"ContainerDied","Data":"0fbb2a8e8bbd95434374d107685d4fc7bb2f82ca25aab0aa4f108a4c6e4fe828"} Jul 07 14:58:55.666446 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.666300 2582 scope.go:117] "RemoveContainer" containerID="24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65" Jul 07 14:58:55.676284 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.676262 2582 scope.go:117] "RemoveContainer" containerID="24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65" Jul 07 14:58:55.676553 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:58:55.676526 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65\": container with ID starting with 24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65 not found: ID does not exist" containerID="24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65" Jul 07 14:58:55.676624 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.676564 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65"} err="failed to get container status \"24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65\": rpc error: code = NotFound desc = could not find container \"24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65\": container with ID starting with 24c148e55b94c54df14d097ff5d21c6db21f2adeda3267ee03ef387c91ef4e65 not found: ID does not exist" Jul 07 14:58:55.691228 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.691203 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f587d767f-brdpb"] Jul 07 14:58:55.696223 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.696200 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f587d767f-brdpb"] Jul 07 14:58:55.990741 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:58:55.990708 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03526a0a-c604-4d13-afe2-3ad062ed91a1" path="/var/lib/kubelet/pods/03526a0a-c604-4d13-afe2-3ad062ed91a1/volumes" Jul 07 14:59:02.694539 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:02.694475 2582 generic.go:356] "Generic (PLEG): container finished" podID="4d6142f6-d100-40e9-83ef-4e83387c7df0" containerID="90e2fb0b68626c2f1f84aa766ee78d35656f23b5f7b5675997d19652e61488a0" exitCode=0 Jul 07 14:59:02.694865 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:02.694540 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" event={"ID":"4d6142f6-d100-40e9-83ef-4e83387c7df0","Type":"ContainerDied","Data":"90e2fb0b68626c2f1f84aa766ee78d35656f23b5f7b5675997d19652e61488a0"} Jul 07 14:59:02.694865 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:02.694822 2582 scope.go:117] "RemoveContainer" containerID="90e2fb0b68626c2f1f84aa766ee78d35656f23b5f7b5675997d19652e61488a0" Jul 07 14:59:03.700072 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:03.700026 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mswfp" event={"ID":"4d6142f6-d100-40e9-83ef-4e83387c7df0","Type":"ContainerStarted","Data":"9f22f1c1ee631cf12c0d48d441e6808ee6c99f6eee2cab90ab1a0da04817ee93"} Jul 07 14:59:08.713219 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:08.713182 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fc84d667f-7dfw8" podUID="d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" containerName="console" containerID="cri-o://21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf" gracePeriod=15 Jul 07 14:59:08.994830 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:08.994773 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:59:09.121702 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.121671 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-trusted-ca-bundle\") pod \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " Jul 07 14:59:09.121858 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.121707 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-serving-cert\") pod \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " Jul 07 14:59:09.121858 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.121768 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-oauth-config\") pod \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " Jul 07 14:59:09.121858 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.121790 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-config\") pod \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " Jul 07 14:59:09.121858 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.121836 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-service-ca\") pod \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " Jul 07 14:59:09.122060 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.121874 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfdpv\" (UniqueName: \"kubernetes.io/projected/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-kube-api-access-kfdpv\") pod \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " Jul 07 14:59:09.122060 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.121908 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-oauth-serving-cert\") pod \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\" (UID: \"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd\") " Jul 07 14:59:09.122264 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.122220 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" (UID: "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:59:09.122264 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.122247 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-config" (OuterVolumeSpecName: "console-config") pod "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" (UID: "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:59:09.122457 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.122371 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" (UID: "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:59:09.122457 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.122445 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" (UID: "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:59:09.123952 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.123929 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" (UID: "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:59:09.124045 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.123954 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-kube-api-access-kfdpv" (OuterVolumeSpecName: "kube-api-access-kfdpv") pod "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" (UID: "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd"). InnerVolumeSpecName "kube-api-access-kfdpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:59:09.124045 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.123985 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" (UID: "d2328f29-ec0b-42c4-9e23-a3bf0c9263dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:59:09.222872 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.222845 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-oauth-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:59:09.222872 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.222869 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:59:09.223028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.222884 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-service-ca\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:59:09.223028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.222895 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfdpv\" (UniqueName: \"kubernetes.io/projected/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-kube-api-access-kfdpv\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:59:09.223028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.222907 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-oauth-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:59:09.223028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.222920 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-trusted-ca-bundle\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:59:09.223028 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.222931 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd-console-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 14:59:09.729300 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.729255 2582 generic.go:356] "Generic (PLEG): container finished" podID="d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" containerID="21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf" exitCode=0 Jul 07 14:59:09.729760 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.729303 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc84d667f-7dfw8" Jul 07 14:59:09.729760 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.729347 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc84d667f-7dfw8" event={"ID":"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd","Type":"ContainerDied","Data":"21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf"} Jul 07 14:59:09.729760 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.729418 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc84d667f-7dfw8" event={"ID":"d2328f29-ec0b-42c4-9e23-a3bf0c9263dd","Type":"ContainerDied","Data":"cd9b502e97949fd0893224275df1dbbb336812aee85bcd3b6e740d38a9558c6d"} Jul 07 14:59:09.729760 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.729438 2582 scope.go:117] "RemoveContainer" containerID="21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf" Jul 07 14:59:09.738237 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.738219 2582 scope.go:117] "RemoveContainer" containerID="21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf" Jul 07 14:59:09.738498 ip-10-0-130-141 kubenswrapper[2582]: E0707 14:59:09.738479 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf\": container with ID starting with 21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf not found: ID does not exist" containerID="21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf" Jul 07 14:59:09.738538 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.738505 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf"} err="failed to get container status \"21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf\": rpc error: code = NotFound desc = could not find container \"21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf\": container with ID starting with 21d72ec489210671bcda0b035cd9e91703d1009edb0eb8eb104fad29a8665ddf not found: ID does not exist" Jul 07 14:59:09.750747 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.750728 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc84d667f-7dfw8"] Jul 07 14:59:09.756630 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.756610 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fc84d667f-7dfw8"] Jul 07 14:59:09.989430 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:09.989364 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" path="/var/lib/kubelet/pods/d2328f29-ec0b-42c4-9e23-a3bf0c9263dd/volumes" Jul 07 14:59:15.757257 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:15.757224 2582 generic.go:356] "Generic (PLEG): container finished" podID="05ac1f53-dadd-4aa7-a572-ef6a13523d30" containerID="35b28d9332b3fb5941747eb2463aa2e3cbdfc96b16b814674fe62ddbf2be8ca4" exitCode=0 Jul 07 14:59:15.757579 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:15.757297 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" event={"ID":"05ac1f53-dadd-4aa7-a572-ef6a13523d30","Type":"ContainerDied","Data":"35b28d9332b3fb5941747eb2463aa2e3cbdfc96b16b814674fe62ddbf2be8ca4"} Jul 07 14:59:15.757618 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:15.757600 2582 scope.go:117] "RemoveContainer" containerID="35b28d9332b3fb5941747eb2463aa2e3cbdfc96b16b814674fe62ddbf2be8ca4" Jul 07 14:59:16.764444 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:16.764396 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pjp67" event={"ID":"05ac1f53-dadd-4aa7-a572-ef6a13523d30","Type":"ContainerStarted","Data":"e841b8e6a5860ce00c6ba933ddd7fe018654ce8b039f4f17baefeb9dbd36d28d"} Jul 07 14:59:53.317317 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317277 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d65f59dc-mvqg9"] Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317543 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddef53a-c82e-449f-bc84-9f9299098651" containerName="console" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317555 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddef53a-c82e-449f-bc84-9f9299098651" containerName="console" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317564 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03526a0a-c604-4d13-afe2-3ad062ed91a1" containerName="registry" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317570 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="03526a0a-c604-4d13-afe2-3ad062ed91a1" containerName="registry" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317586 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" containerName="console" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317594 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" containerName="console" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317670 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddef53a-c82e-449f-bc84-9f9299098651" containerName="console" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317679 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2328f29-ec0b-42c4-9e23-a3bf0c9263dd" containerName="console" Jul 07 14:59:53.317783 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.317688 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="03526a0a-c604-4d13-afe2-3ad062ed91a1" containerName="registry" Jul 07 14:59:53.320329 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.320308 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.335239 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.335217 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d65f59dc-mvqg9"] Jul 07 14:59:53.415507 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.415467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-oauth-config\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.415668 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.415521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-service-ca\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.415668 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.415575 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-serving-cert\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.415668 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.415604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-oauth-serving-cert\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.415668 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.415634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-trusted-ca-bundle\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.415668 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.415648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kd6r\" (UniqueName: \"kubernetes.io/projected/5e2c54ef-be15-4715-b380-a65c8357a069-kube-api-access-8kd6r\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.415845 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.415693 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-console-config\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.516108 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.516049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-oauth-config\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.516295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.516131 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-service-ca\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.516295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.516163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-serving-cert\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.516295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.516190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-oauth-serving-cert\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.516295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.516228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-trusted-ca-bundle\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.516295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.516251 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kd6r\" (UniqueName: \"kubernetes.io/projected/5e2c54ef-be15-4715-b380-a65c8357a069-kube-api-access-8kd6r\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.516295 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.516288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-console-config\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.517040 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.517011 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-oauth-serving-cert\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.517187 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.517047 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-service-ca\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.517187 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.517140 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-console-config\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.517187 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.517145 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-trusted-ca-bundle\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.518625 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.518597 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-serving-cert\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.518749 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.518727 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-oauth-config\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.525521 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.525502 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kd6r\" (UniqueName: \"kubernetes.io/projected/5e2c54ef-be15-4715-b380-a65c8357a069-kube-api-access-8kd6r\") pod \"console-74d65f59dc-mvqg9\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.629491 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.629420 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 14:59:53.761450 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.761403 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d65f59dc-mvqg9"] Jul 07 14:59:53.764163 ip-10-0-130-141 kubenswrapper[2582]: W0707 14:59:53.764137 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2c54ef_be15_4715_b380_a65c8357a069.slice/crio-c46db8b8eaaa8f1346a3d14d245d165c4a36784926e390fea3add3f0a76ca760 WatchSource:0}: Error finding container c46db8b8eaaa8f1346a3d14d245d165c4a36784926e390fea3add3f0a76ca760: Status 404 returned error can't find the container with id c46db8b8eaaa8f1346a3d14d245d165c4a36784926e390fea3add3f0a76ca760 Jul 07 14:59:53.896128 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.896093 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d65f59dc-mvqg9" event={"ID":"5e2c54ef-be15-4715-b380-a65c8357a069","Type":"ContainerStarted","Data":"f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3"} Jul 07 14:59:53.896284 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.896154 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d65f59dc-mvqg9" event={"ID":"5e2c54ef-be15-4715-b380-a65c8357a069","Type":"ContainerStarted","Data":"c46db8b8eaaa8f1346a3d14d245d165c4a36784926e390fea3add3f0a76ca760"} Jul 07 14:59:53.916809 ip-10-0-130-141 kubenswrapper[2582]: I0707 14:59:53.916768 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d65f59dc-mvqg9" podStartSLOduration=0.916752695 podStartE2EDuration="916.752695ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:59:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:59:53.916198406 +0000 UTC m=+182.640100251" watchObservedRunningTime="2026-07-07 14:59:53.916752695 +0000 UTC m=+182.640654556" Jul 07 15:00:03.629770 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:03.629734 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 15:00:03.630231 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:03.629819 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 15:00:03.634214 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:03.634195 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 15:00:03.940421 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:03.940391 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 15:00:03.989650 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:03.989623 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd68cf96b-9lfqr"] Jul 07 15:00:04.064179 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.064150 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-769f6b5f74-xxrc5"] Jul 07 15:00:04.066381 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.066364 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.083232 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.083207 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769f6b5f74-xxrc5"] Jul 07 15:00:04.088102 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.088058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-oauth-config\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.088190 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.088128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9684\" (UniqueName: \"kubernetes.io/projected/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-kube-api-access-d9684\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.088232 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.088197 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-config\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.088266 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.088229 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-trusted-ca-bundle\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.088266 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.088253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-serving-cert\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.088334 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.088313 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-service-ca\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.088369 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.088355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-oauth-serving-cert\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.189594 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.189566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-trusted-ca-bundle\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.189722 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.189608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-serving-cert\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.189722 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.189631 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-service-ca\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.189722 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.189652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-oauth-serving-cert\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.189722 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.189677 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-oauth-config\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.189722 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.189697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9684\" (UniqueName: \"kubernetes.io/projected/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-kube-api-access-d9684\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.189976 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.189733 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-config\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.190566 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.190511 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-service-ca\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.190566 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.190517 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-oauth-serving-cert\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.190674 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.190573 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-trusted-ca-bundle\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.190674 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.190613 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-config\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.192117 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.192090 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-oauth-config\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.192284 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.192270 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-console-serving-cert\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.199702 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.199683 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9684\" (UniqueName: \"kubernetes.io/projected/32eb5acb-e3d8-44e4-a750-49de5d3bacd1-kube-api-access-d9684\") pod \"console-769f6b5f74-xxrc5\" (UID: \"32eb5acb-e3d8-44e4-a750-49de5d3bacd1\") " pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.376147 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.376114 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:04.504007 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.503937 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769f6b5f74-xxrc5"] Jul 07 15:00:04.506511 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:00:04.506484 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32eb5acb_e3d8_44e4_a750_49de5d3bacd1.slice/crio-24335b4c1aad6cb8afea7f2b223de74b053d041578e7586bb9743ba5a683b906 WatchSource:0}: Error finding container 24335b4c1aad6cb8afea7f2b223de74b053d041578e7586bb9743ba5a683b906: Status 404 returned error can't find the container with id 24335b4c1aad6cb8afea7f2b223de74b053d041578e7586bb9743ba5a683b906 Jul 07 15:00:04.941742 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.941708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769f6b5f74-xxrc5" event={"ID":"32eb5acb-e3d8-44e4-a750-49de5d3bacd1","Type":"ContainerStarted","Data":"818eec1e35b68d624b885ecc7ab5e6f2fc87a271a4383c45ff6d1d04f6503aa7"} Jul 07 15:00:04.942141 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.941761 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769f6b5f74-xxrc5" event={"ID":"32eb5acb-e3d8-44e4-a750-49de5d3bacd1","Type":"ContainerStarted","Data":"24335b4c1aad6cb8afea7f2b223de74b053d041578e7586bb9743ba5a683b906"} Jul 07 15:00:04.967306 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:04.967254 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-769f6b5f74-xxrc5" podStartSLOduration=0.967239265 podStartE2EDuration="967.239265ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:00:04.965852453 +0000 UTC m=+193.689754274" watchObservedRunningTime="2026-07-07 15:00:04.967239265 +0000 UTC m=+193.691141083" Jul 07 15:00:14.377133 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:14.377096 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:14.377700 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:14.377167 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:14.381858 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:14.381835 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:14.982790 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:14.982761 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-769f6b5f74-xxrc5" Jul 07 15:00:15.031301 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:15.031274 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d65f59dc-mvqg9"] Jul 07 15:00:29.016141 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.016094 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bd68cf96b-9lfqr" podUID="dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" containerName="console" containerID="cri-o://c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4" gracePeriod=15 Jul 07 15:00:29.273763 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.273710 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 15:00:29.351977 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.351951 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-config\") pod \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " Jul 07 15:00:29.352156 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.351988 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jzj6\" (UniqueName: \"kubernetes.io/projected/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-kube-api-access-5jzj6\") pod \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " Jul 07 15:00:29.352156 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352019 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-trusted-ca-bundle\") pod \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " Jul 07 15:00:29.352156 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352037 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-serving-cert\") pod \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " Jul 07 15:00:29.352156 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352099 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-service-ca\") pod \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " Jul 07 15:00:29.352156 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352126 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-oauth-config\") pod \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " Jul 07 15:00:29.352156 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352151 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-oauth-serving-cert\") pod \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\" (UID: \"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966\") " Jul 07 15:00:29.352582 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352535 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" (UID: "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:29.352582 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352556 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-service-ca" (OuterVolumeSpecName: "service-ca") pod "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" (UID: "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:29.352692 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352612 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-config" (OuterVolumeSpecName: "console-config") pod "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" (UID: "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:29.352692 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.352618 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" (UID: "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:29.354209 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.354188 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" (UID: "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:00:29.354562 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.354541 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-kube-api-access-5jzj6" (OuterVolumeSpecName: "kube-api-access-5jzj6") pod "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" (UID: "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966"). InnerVolumeSpecName "kube-api-access-5jzj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:00:29.354617 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.354580 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" (UID: "dde1df40-f8bc-4e31-8bb4-e0ea96c3f966"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:00:29.452836 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.452797 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:29.452836 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.452830 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jzj6\" (UniqueName: \"kubernetes.io/projected/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-kube-api-access-5jzj6\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:29.452836 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.452844 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-trusted-ca-bundle\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:29.453098 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.452857 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:29.453098 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.452870 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-service-ca\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:29.453098 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.452882 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-console-oauth-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:29.453098 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:29.452894 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966-oauth-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:30.033661 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.033626 2582 generic.go:356] "Generic (PLEG): container finished" podID="dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" containerID="c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4" exitCode=0 Jul 07 15:00:30.034050 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.033674 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd68cf96b-9lfqr" Jul 07 15:00:30.034050 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.033688 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd68cf96b-9lfqr" event={"ID":"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966","Type":"ContainerDied","Data":"c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4"} Jul 07 15:00:30.034050 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.033727 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd68cf96b-9lfqr" event={"ID":"dde1df40-f8bc-4e31-8bb4-e0ea96c3f966","Type":"ContainerDied","Data":"ebdfff6433c57c534fa3f45ae6f67e75e398d72f7dcf937f6b820df4efcb89c8"} Jul 07 15:00:30.034050 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.033746 2582 scope.go:117] "RemoveContainer" containerID="c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4" Jul 07 15:00:30.041861 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.041843 2582 scope.go:117] "RemoveContainer" containerID="c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4" Jul 07 15:00:30.042133 ip-10-0-130-141 kubenswrapper[2582]: E0707 15:00:30.042111 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4\": container with ID starting with c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4 not found: ID does not exist" containerID="c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4" Jul 07 15:00:30.042197 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.042145 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4"} err="failed to get container status \"c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4\": rpc error: code = NotFound desc = could not find container \"c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4\": container with ID starting with c8840fd22585a99edce7affee35f5daa58cf8869479c4b53cb2d6e980a2a2dd4 not found: ID does not exist" Jul 07 15:00:30.054730 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.054709 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd68cf96b-9lfqr"] Jul 07 15:00:30.061893 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:30.059658 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd68cf96b-9lfqr"] Jul 07 15:00:31.990119 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:31.990060 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" path="/var/lib/kubelet/pods/dde1df40-f8bc-4e31-8bb4-e0ea96c3f966/volumes" Jul 07 15:00:40.052287 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.052231 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74d65f59dc-mvqg9" podUID="5e2c54ef-be15-4715-b380-a65c8357a069" containerName="console" containerID="cri-o://f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3" gracePeriod=15 Jul 07 15:00:40.297626 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.297603 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 15:00:40.317936 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.317884 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-oauth-serving-cert\") pod \"5e2c54ef-be15-4715-b380-a65c8357a069\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " Jul 07 15:00:40.317936 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.317913 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-oauth-config\") pod \"5e2c54ef-be15-4715-b380-a65c8357a069\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " Jul 07 15:00:40.317936 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.317929 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-trusted-ca-bundle\") pod \"5e2c54ef-be15-4715-b380-a65c8357a069\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " Jul 07 15:00:40.318141 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.317947 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-console-config\") pod \"5e2c54ef-be15-4715-b380-a65c8357a069\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " Jul 07 15:00:40.318200 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318175 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-service-ca\") pod \"5e2c54ef-be15-4715-b380-a65c8357a069\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " Jul 07 15:00:40.318254 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318230 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-serving-cert\") pod \"5e2c54ef-be15-4715-b380-a65c8357a069\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " Jul 07 15:00:40.318305 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318263 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kd6r\" (UniqueName: \"kubernetes.io/projected/5e2c54ef-be15-4715-b380-a65c8357a069-kube-api-access-8kd6r\") pod \"5e2c54ef-be15-4715-b380-a65c8357a069\" (UID: \"5e2c54ef-be15-4715-b380-a65c8357a069\") " Jul 07 15:00:40.318305 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318284 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e2c54ef-be15-4715-b380-a65c8357a069" (UID: "5e2c54ef-be15-4715-b380-a65c8357a069"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:40.318436 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318308 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-console-config" (OuterVolumeSpecName: "console-config") pod "5e2c54ef-be15-4715-b380-a65c8357a069" (UID: "5e2c54ef-be15-4715-b380-a65c8357a069"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:40.318515 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318439 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5e2c54ef-be15-4715-b380-a65c8357a069" (UID: "5e2c54ef-be15-4715-b380-a65c8357a069"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:40.318515 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318471 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e2c54ef-be15-4715-b380-a65c8357a069" (UID: "5e2c54ef-be15-4715-b380-a65c8357a069"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:00:40.318515 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318488 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-oauth-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:40.318515 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.318507 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-console-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:40.320109 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.320083 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e2c54ef-be15-4715-b380-a65c8357a069" (UID: "5e2c54ef-be15-4715-b380-a65c8357a069"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:00:40.320219 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.320119 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e2c54ef-be15-4715-b380-a65c8357a069" (UID: "5e2c54ef-be15-4715-b380-a65c8357a069"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:00:40.320278 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.320263 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2c54ef-be15-4715-b380-a65c8357a069-kube-api-access-8kd6r" (OuterVolumeSpecName: "kube-api-access-8kd6r") pod "5e2c54ef-be15-4715-b380-a65c8357a069" (UID: "5e2c54ef-be15-4715-b380-a65c8357a069"). InnerVolumeSpecName "kube-api-access-8kd6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:00:40.419107 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.419081 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-oauth-config\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:40.419107 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.419105 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-trusted-ca-bundle\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:40.419255 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.419115 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e2c54ef-be15-4715-b380-a65c8357a069-service-ca\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:40.419255 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.419124 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e2c54ef-be15-4715-b380-a65c8357a069-console-serving-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:40.419255 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:40.419133 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kd6r\" (UniqueName: \"kubernetes.io/projected/5e2c54ef-be15-4715-b380-a65c8357a069-kube-api-access-8kd6r\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:00:41.075138 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.075106 2582 generic.go:356] "Generic (PLEG): container finished" podID="5e2c54ef-be15-4715-b380-a65c8357a069" containerID="f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3" exitCode=0 Jul 07 15:00:41.075597 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.075147 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d65f59dc-mvqg9" Jul 07 15:00:41.075597 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.075162 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d65f59dc-mvqg9" event={"ID":"5e2c54ef-be15-4715-b380-a65c8357a069","Type":"ContainerDied","Data":"f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3"} Jul 07 15:00:41.075597 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.075197 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d65f59dc-mvqg9" event={"ID":"5e2c54ef-be15-4715-b380-a65c8357a069","Type":"ContainerDied","Data":"c46db8b8eaaa8f1346a3d14d245d165c4a36784926e390fea3add3f0a76ca760"} Jul 07 15:00:41.075597 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.075215 2582 scope.go:117] "RemoveContainer" containerID="f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3" Jul 07 15:00:41.083210 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.083189 2582 scope.go:117] "RemoveContainer" containerID="f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3" Jul 07 15:00:41.083456 ip-10-0-130-141 kubenswrapper[2582]: E0707 15:00:41.083435 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3\": container with ID starting with f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3 not found: ID does not exist" containerID="f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3" Jul 07 15:00:41.083522 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.083469 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3"} err="failed to get container status \"f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3\": rpc error: code = NotFound desc = could not find container \"f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3\": container with ID starting with f13580b86863ba4e847e119473533927cbff778b7baf442ca3d153a6fee722b3 not found: ID does not exist" Jul 07 15:00:41.100041 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.100022 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d65f59dc-mvqg9"] Jul 07 15:00:41.106882 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.106864 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d65f59dc-mvqg9"] Jul 07 15:00:41.988931 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:00:41.988900 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e2c54ef-be15-4715-b380-a65c8357a069" path="/var/lib/kubelet/pods/5e2c54ef-be15-4715-b380-a65c8357a069/volumes" Jul 07 15:01:51.706480 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:51.706444 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:01:51.709893 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:51.709872 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:01:51.717851 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:51.717834 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:01:51.721667 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:51.721649 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 15:01:51.721771 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:51.721719 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:01:58.707913 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.707870 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2"] Jul 07 15:01:58.709498 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.708271 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2c54ef-be15-4715-b380-a65c8357a069" containerName="console" Jul 07 15:01:58.709498 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.708289 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2c54ef-be15-4715-b380-a65c8357a069" containerName="console" Jul 07 15:01:58.709498 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.708309 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" containerName="console" Jul 07 15:01:58.709498 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.708317 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" containerName="console" Jul 07 15:01:58.709498 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.708377 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde1df40-f8bc-4e31-8bb4-e0ea96c3f966" containerName="console" Jul 07 15:01:58.709498 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.708387 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2c54ef-be15-4715-b380-a65c8357a069" containerName="console" Jul 07 15:01:58.710346 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.710326 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.714679 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.714658 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 15:01:58.714787 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.714760 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cwf77\"" Jul 07 15:01:58.716178 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.716158 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 15:01:58.730622 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.730598 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2"] Jul 07 15:01:58.845564 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.845538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzdg\" (UniqueName: \"kubernetes.io/projected/8253ce6d-4ede-47e5-92c4-42f45bc047fc-kube-api-access-xhzdg\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.845678 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.845589 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.845678 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.845612 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.946789 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.946754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzdg\" (UniqueName: \"kubernetes.io/projected/8253ce6d-4ede-47e5-92c4-42f45bc047fc-kube-api-access-xhzdg\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.946939 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.946816 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.946939 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.946841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.947195 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.947176 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.947238 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.947211 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:58.955512 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:58.955493 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzdg\" (UniqueName: \"kubernetes.io/projected/8253ce6d-4ede-47e5-92c4-42f45bc047fc-kube-api-access-xhzdg\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:59.019344 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:59.019289 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:01:59.143467 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:59.143443 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2"] Jul 07 15:01:59.146049 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:01:59.146022 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8253ce6d_4ede_47e5_92c4_42f45bc047fc.slice/crio-f1aee70d161be9f0b6a32ef93d8d9ad7c7bb5c939adbb8faa6197730f275b580 WatchSource:0}: Error finding container f1aee70d161be9f0b6a32ef93d8d9ad7c7bb5c939adbb8faa6197730f275b580: Status 404 returned error can't find the container with id f1aee70d161be9f0b6a32ef93d8d9ad7c7bb5c939adbb8faa6197730f275b580 Jul 07 15:01:59.147949 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:59.147934 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:01:59.341168 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:01:59.341088 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" event={"ID":"8253ce6d-4ede-47e5-92c4-42f45bc047fc","Type":"ContainerStarted","Data":"f1aee70d161be9f0b6a32ef93d8d9ad7c7bb5c939adbb8faa6197730f275b580"} Jul 07 15:02:08.377161 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:08.377049 2582 generic.go:356] "Generic (PLEG): container finished" podID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerID="40afbf851b6e20d43c4e1d74f2166efb6f7304c632b3d94cecee581ae33cc151" exitCode=0 Jul 07 15:02:08.377161 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:08.377093 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" event={"ID":"8253ce6d-4ede-47e5-92c4-42f45bc047fc","Type":"ContainerDied","Data":"40afbf851b6e20d43c4e1d74f2166efb6f7304c632b3d94cecee581ae33cc151"} Jul 07 15:02:10.385418 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:10.385383 2582 generic.go:356] "Generic (PLEG): container finished" podID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerID="7c468577c5a5e618b1ad0cea732ec00dfb29cd104c9fb3d57cdc016b77a3e3de" exitCode=0 Jul 07 15:02:10.385768 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:10.385468 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" event={"ID":"8253ce6d-4ede-47e5-92c4-42f45bc047fc","Type":"ContainerDied","Data":"7c468577c5a5e618b1ad0cea732ec00dfb29cd104c9fb3d57cdc016b77a3e3de"} Jul 07 15:02:19.421926 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:19.421894 2582 generic.go:356] "Generic (PLEG): container finished" podID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerID="cc1bcdde7c982f1442f9d797016c46f5af18d96e080d53860c1d52b051140a7c" exitCode=0 Jul 07 15:02:19.422303 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:19.421970 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" event={"ID":"8253ce6d-4ede-47e5-92c4-42f45bc047fc","Type":"ContainerDied","Data":"cc1bcdde7c982f1442f9d797016c46f5af18d96e080d53860c1d52b051140a7c"} Jul 07 15:02:20.598039 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.598013 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:02:20.720932 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.720853 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhzdg\" (UniqueName: \"kubernetes.io/projected/8253ce6d-4ede-47e5-92c4-42f45bc047fc-kube-api-access-xhzdg\") pod \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " Jul 07 15:02:20.720932 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.720894 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-util\") pod \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " Jul 07 15:02:20.720932 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.720920 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-bundle\") pod \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\" (UID: \"8253ce6d-4ede-47e5-92c4-42f45bc047fc\") " Jul 07 15:02:20.721610 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.721584 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-bundle" (OuterVolumeSpecName: "bundle") pod "8253ce6d-4ede-47e5-92c4-42f45bc047fc" (UID: "8253ce6d-4ede-47e5-92c4-42f45bc047fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:02:20.723029 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.723005 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8253ce6d-4ede-47e5-92c4-42f45bc047fc-kube-api-access-xhzdg" (OuterVolumeSpecName: "kube-api-access-xhzdg") pod "8253ce6d-4ede-47e5-92c4-42f45bc047fc" (UID: "8253ce6d-4ede-47e5-92c4-42f45bc047fc"). InnerVolumeSpecName "kube-api-access-xhzdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:02:20.725591 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.725569 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-util" (OuterVolumeSpecName: "util") pod "8253ce6d-4ede-47e5-92c4-42f45bc047fc" (UID: "8253ce6d-4ede-47e5-92c4-42f45bc047fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:02:20.821589 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.821566 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-util\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:02:20.821589 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.821589 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8253ce6d-4ede-47e5-92c4-42f45bc047fc-bundle\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:02:20.821717 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:20.821603 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhzdg\" (UniqueName: \"kubernetes.io/projected/8253ce6d-4ede-47e5-92c4-42f45bc047fc-kube-api-access-xhzdg\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:02:21.432301 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:21.432277 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" Jul 07 15:02:21.432469 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:21.432273 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5898gml2" event={"ID":"8253ce6d-4ede-47e5-92c4-42f45bc047fc","Type":"ContainerDied","Data":"f1aee70d161be9f0b6a32ef93d8d9ad7c7bb5c939adbb8faa6197730f275b580"} Jul 07 15:02:21.432469 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:21.432401 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1aee70d161be9f0b6a32ef93d8d9ad7c7bb5c939adbb8faa6197730f275b580" Jul 07 15:02:27.068330 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068290 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb"] Jul 07 15:02:27.068790 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068690 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerName="extract" Jul 07 15:02:27.068790 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068708 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerName="extract" Jul 07 15:02:27.068790 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068725 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerName="util" Jul 07 15:02:27.068790 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068733 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerName="util" Jul 07 15:02:27.068790 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068742 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerName="pull" Jul 07 15:02:27.068790 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068750 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerName="pull" Jul 07 15:02:27.069110 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.068823 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8253ce6d-4ede-47e5-92c4-42f45bc047fc" containerName="extract" Jul 07 15:02:27.071018 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.070997 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.073663 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.073637 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 07 15:02:27.073663 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.073648 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-lwhs6\"" Jul 07 15:02:27.073814 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.073667 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 07 15:02:27.073814 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.073644 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 07 15:02:27.083361 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.083342 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb"] Jul 07 15:02:27.162468 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.162439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/7d55e18d-0321-4a10-aef6-54c128ca9026-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-67dfb\" (UID: \"7d55e18d-0321-4a10-aef6-54c128ca9026\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.162594 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.162502 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fflxs\" (UniqueName: \"kubernetes.io/projected/7d55e18d-0321-4a10-aef6-54c128ca9026-kube-api-access-fflxs\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-67dfb\" (UID: \"7d55e18d-0321-4a10-aef6-54c128ca9026\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.263023 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.262989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fflxs\" (UniqueName: \"kubernetes.io/projected/7d55e18d-0321-4a10-aef6-54c128ca9026-kube-api-access-fflxs\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-67dfb\" (UID: \"7d55e18d-0321-4a10-aef6-54c128ca9026\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.263213 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.263041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/7d55e18d-0321-4a10-aef6-54c128ca9026-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-67dfb\" (UID: \"7d55e18d-0321-4a10-aef6-54c128ca9026\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.265285 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.265262 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/7d55e18d-0321-4a10-aef6-54c128ca9026-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-67dfb\" (UID: \"7d55e18d-0321-4a10-aef6-54c128ca9026\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.271785 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.271766 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fflxs\" (UniqueName: \"kubernetes.io/projected/7d55e18d-0321-4a10-aef6-54c128ca9026-kube-api-access-fflxs\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-67dfb\" (UID: \"7d55e18d-0321-4a10-aef6-54c128ca9026\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.380443 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.380384 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:27.509987 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:27.509960 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb"] Jul 07 15:02:27.512877 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:02:27.512852 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d55e18d_0321_4a10_aef6_54c128ca9026.slice/crio-e8e5922814e272c7f9867b0130a66c9efcd07b57efe74659cd4bc0978fc9a35f WatchSource:0}: Error finding container e8e5922814e272c7f9867b0130a66c9efcd07b57efe74659cd4bc0978fc9a35f: Status 404 returned error can't find the container with id e8e5922814e272c7f9867b0130a66c9efcd07b57efe74659cd4bc0978fc9a35f Jul 07 15:02:28.459135 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:28.459102 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" event={"ID":"7d55e18d-0321-4a10-aef6-54c128ca9026","Type":"ContainerStarted","Data":"e8e5922814e272c7f9867b0130a66c9efcd07b57efe74659cd4bc0978fc9a35f"} Jul 07 15:02:31.474154 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.474115 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" event={"ID":"7d55e18d-0321-4a10-aef6-54c128ca9026","Type":"ContainerStarted","Data":"dd635c4dc5db3c2cbcd1c0c1eba724a074fa293926137d7240ee310361a3ecf7"} Jul 07 15:02:31.474625 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.474316 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:31.494846 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.494775 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" podStartSLOduration=1.071204456 podStartE2EDuration="4.494758966s" totalImagesPullingTime="3.42355451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:31.493416751 +0000 UTC m=+340.217318578" watchObservedRunningTime="2026-07-07 15:02:31.494758966 +0000 UTC m=+340.218660784" Jul 07 15:02:31.799082 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.798986 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-wvrx9"] Jul 07 15:02:31.801029 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.801010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.803522 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.803503 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 07 15:02:31.803626 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.803526 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 07 15:02:31.803626 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.803540 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-mkv8m\"" Jul 07 15:02:31.814158 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.814135 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-wvrx9"] Jul 07 15:02:31.891608 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.891578 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-certificates\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.891749 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.891619 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2lcr\" (UniqueName: \"kubernetes.io/projected/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-kube-api-access-x2lcr\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.891749 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.891648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-cabundle0\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.992277 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.992243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-certificates\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.992410 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.992292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2lcr\" (UniqueName: \"kubernetes.io/projected/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-kube-api-access-x2lcr\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.992410 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.992322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-cabundle0\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.993078 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.993043 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-cabundle0\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:31.994788 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:31.994762 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-certificates\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:32.001197 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.001174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2lcr\" (UniqueName: \"kubernetes.io/projected/752df4d6-ea48-4c9f-b2ac-6fe123d75a03-kube-api-access-x2lcr\") pod \"keda-operator-68bff59c-wvrx9\" (UID: \"752df4d6-ea48-4c9f-b2ac-6fe123d75a03\") " pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:32.008960 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.008924 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg"] Jul 07 15:02:32.011401 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.011385 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.014300 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.014283 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 07 15:02:32.022642 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.022624 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg"] Jul 07 15:02:32.093019 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.092939 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/34f55228-c550-41d6-8328-c1fd25637c6a-certificates\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.093019 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.092982 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/34f55228-c550-41d6-8328-c1fd25637c6a-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.093019 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.093008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbcgf\" (UniqueName: \"kubernetes.io/projected/34f55228-c550-41d6-8328-c1fd25637c6a-kube-api-access-kbcgf\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.110867 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.110841 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:32.193755 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.193721 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/34f55228-c550-41d6-8328-c1fd25637c6a-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.193931 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.193764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbcgf\" (UniqueName: \"kubernetes.io/projected/34f55228-c550-41d6-8328-c1fd25637c6a-kube-api-access-kbcgf\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.193931 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.193875 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/34f55228-c550-41d6-8328-c1fd25637c6a-certificates\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.194479 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.194430 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/34f55228-c550-41d6-8328-c1fd25637c6a-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.197872 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.197707 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/34f55228-c550-41d6-8328-c1fd25637c6a-certificates\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.204699 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.204510 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2cfx9"] Jul 07 15:02:32.208568 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.208545 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.210777 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.210751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbcgf\" (UniqueName: \"kubernetes.io/projected/34f55228-c550-41d6-8328-c1fd25637c6a-kube-api-access-kbcgf\") pod \"keda-metrics-apiserver-559f75f947-q5kcg\" (UID: \"34f55228-c550-41d6-8328-c1fd25637c6a\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.211320 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.211298 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 07 15:02:32.218762 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.218540 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2cfx9"] Jul 07 15:02:32.294301 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.294268 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htc4f\" (UniqueName: \"kubernetes.io/projected/9789019e-9c2a-482f-8786-27994a02edcf-kube-api-access-htc4f\") pod \"keda-admission-5fbd5c4644-2cfx9\" (UID: \"9789019e-9c2a-482f-8786-27994a02edcf\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.294301 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.294308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9789019e-9c2a-482f-8786-27994a02edcf-certificates\") pod \"keda-admission-5fbd5c4644-2cfx9\" (UID: \"9789019e-9c2a-482f-8786-27994a02edcf\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.321607 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.321583 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:32.394910 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.394880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9789019e-9c2a-482f-8786-27994a02edcf-certificates\") pod \"keda-admission-5fbd5c4644-2cfx9\" (UID: \"9789019e-9c2a-482f-8786-27994a02edcf\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.395085 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.394967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc4f\" (UniqueName: \"kubernetes.io/projected/9789019e-9c2a-482f-8786-27994a02edcf-kube-api-access-htc4f\") pod \"keda-admission-5fbd5c4644-2cfx9\" (UID: \"9789019e-9c2a-482f-8786-27994a02edcf\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.397225 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.397202 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9789019e-9c2a-482f-8786-27994a02edcf-certificates\") pod \"keda-admission-5fbd5c4644-2cfx9\" (UID: \"9789019e-9c2a-482f-8786-27994a02edcf\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.407208 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.407119 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htc4f\" (UniqueName: \"kubernetes.io/projected/9789019e-9c2a-482f-8786-27994a02edcf-kube-api-access-htc4f\") pod \"keda-admission-5fbd5c4644-2cfx9\" (UID: \"9789019e-9c2a-482f-8786-27994a02edcf\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.450121 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.450096 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg"] Jul 07 15:02:32.452517 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:02:32.452464 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f55228_c550_41d6_8328_c1fd25637c6a.slice/crio-56d47b5f79c1e64b7797e3836d7cad1521e0eb70fc71d0d872a9d22f0143a342 WatchSource:0}: Error finding container 56d47b5f79c1e64b7797e3836d7cad1521e0eb70fc71d0d872a9d22f0143a342: Status 404 returned error can't find the container with id 56d47b5f79c1e64b7797e3836d7cad1521e0eb70fc71d0d872a9d22f0143a342 Jul 07 15:02:32.455048 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.455024 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-wvrx9"] Jul 07 15:02:32.457250 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:02:32.457225 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752df4d6_ea48_4c9f_b2ac_6fe123d75a03.slice/crio-6738e19ae4fbc06c17fac04e1de10475bd436d99c78627253b46dc128dc01890 WatchSource:0}: Error finding container 6738e19ae4fbc06c17fac04e1de10475bd436d99c78627253b46dc128dc01890: Status 404 returned error can't find the container with id 6738e19ae4fbc06c17fac04e1de10475bd436d99c78627253b46dc128dc01890 Jul 07 15:02:32.479586 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.479561 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-wvrx9" event={"ID":"752df4d6-ea48-4c9f-b2ac-6fe123d75a03","Type":"ContainerStarted","Data":"6738e19ae4fbc06c17fac04e1de10475bd436d99c78627253b46dc128dc01890"} Jul 07 15:02:32.480706 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.480677 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" event={"ID":"34f55228-c550-41d6-8328-c1fd25637c6a","Type":"ContainerStarted","Data":"56d47b5f79c1e64b7797e3836d7cad1521e0eb70fc71d0d872a9d22f0143a342"} Jul 07 15:02:32.523812 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.523791 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:32.650702 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:32.650681 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2cfx9"] Jul 07 15:02:32.653247 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:02:32.653218 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9789019e_9c2a_482f_8786_27994a02edcf.slice/crio-42ea8689a38887f1112bb3244ab48f3b90b3e40c146517d09f808bdbe930b867 WatchSource:0}: Error finding container 42ea8689a38887f1112bb3244ab48f3b90b3e40c146517d09f808bdbe930b867: Status 404 returned error can't find the container with id 42ea8689a38887f1112bb3244ab48f3b90b3e40c146517d09f808bdbe930b867 Jul 07 15:02:33.491507 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:33.491464 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" event={"ID":"9789019e-9c2a-482f-8786-27994a02edcf","Type":"ContainerStarted","Data":"42ea8689a38887f1112bb3244ab48f3b90b3e40c146517d09f808bdbe930b867"} Jul 07 15:02:37.510677 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.510642 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-wvrx9" event={"ID":"752df4d6-ea48-4c9f-b2ac-6fe123d75a03","Type":"ContainerStarted","Data":"451a23ba7a6f95d5213b5ce801d1042e76d9d180a8488ac0977b63500263efc5"} Jul 07 15:02:37.511152 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.510770 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:37.512173 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.512152 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" event={"ID":"9789019e-9c2a-482f-8786-27994a02edcf","Type":"ContainerStarted","Data":"6ceecd2af2b66e7df5cceb44a4d9ae147d0ac613903302b8ab81117a3e4e6997"} Jul 07 15:02:37.512266 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.512198 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:02:37.513542 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.513525 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" event={"ID":"34f55228-c550-41d6-8328-c1fd25637c6a","Type":"ContainerStarted","Data":"bd4445f9fc7866adffd54223c5e4b80617fe7987d94633b43da62469b074e38a"} Jul 07 15:02:37.513622 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.513597 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:37.529755 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.529719 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-wvrx9" podStartSLOduration=2.448699125 podStartE2EDuration="6.52970685s" totalImagesPullingTime="4.081007725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:37.527442777 +0000 UTC m=+346.251344609" watchObservedRunningTime="2026-07-07 15:02:37.52970685 +0000 UTC m=+346.253608667" Jul 07 15:02:37.545131 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.545095 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" podStartSLOduration=2.504494539 podStartE2EDuration="6.545040046s" totalImagesPullingTime="4.040545507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:37.543945269 +0000 UTC m=+346.267847088" watchObservedRunningTime="2026-07-07 15:02:37.545040046 +0000 UTC m=+346.268941864" Jul 07 15:02:37.562349 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:37.562314 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" podStartSLOduration=1.718005263 podStartE2EDuration="5.562303348s" totalImagesPullingTime="3.844298085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:37.561621521 +0000 UTC m=+346.285523339" watchObservedRunningTime="2026-07-07 15:02:37.562303348 +0000 UTC m=+346.286205165" Jul 07 15:02:48.523841 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:48.523763 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-q5kcg" Jul 07 15:02:52.483123 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:52.483094 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-67dfb" Jul 07 15:02:58.521001 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:58.520968 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-wvrx9" Jul 07 15:02:58.521406 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:02:58.521050 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-2cfx9" Jul 07 15:03:42.758785 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.758748 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-jmbp5"] Jul 07 15:03:42.761168 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.761147 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:42.766644 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.765518 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-xlbmb\"" Jul 07 15:03:42.766644 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.765809 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 15:03:42.766644 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.766179 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 07 15:03:42.766644 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.766384 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 15:03:42.773256 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.771529 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-pvw8z"] Jul 07 15:03:42.776182 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.776157 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-jmbp5"] Jul 07 15:03:42.776313 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.776269 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:42.779726 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.779690 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 07 15:03:42.779937 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.779755 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-j2p2d\"" Jul 07 15:03:42.791423 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.791400 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-pvw8z"] Jul 07 15:03:42.801449 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.801430 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-gnmkv"] Jul 07 15:03:42.803708 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.803693 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:42.806636 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.806618 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-xkrnz\"" Jul 07 15:03:42.806736 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.806618 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 07 15:03:42.815739 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.815713 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-gnmkv"] Jul 07 15:03:42.908682 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.908650 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf9cq\" (UniqueName: \"kubernetes.io/projected/c1bd428c-2088-4af4-99c8-f6b6fb10a639-kube-api-access-zf9cq\") pod \"kserve-controller-manager-666b75c8f7-jmbp5\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:42.908811 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.908704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnl2l\" (UniqueName: \"kubernetes.io/projected/28c5188e-7075-415e-b4dc-2a02940d758a-kube-api-access-jnl2l\") pod \"llmisvc-controller-manager-67d95fdc48-pvw8z\" (UID: \"28c5188e-7075-415e-b4dc-2a02940d758a\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:42.908811 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.908756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac-data\") pod \"seaweedfs-64568bcd49-gnmkv\" (UID: \"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac\") " pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:42.908811 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.908802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28c5188e-7075-415e-b4dc-2a02940d758a-cert\") pod \"llmisvc-controller-manager-67d95fdc48-pvw8z\" (UID: \"28c5188e-7075-415e-b4dc-2a02940d758a\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:42.908928 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.908818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert\") pod \"kserve-controller-manager-666b75c8f7-jmbp5\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:42.908928 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:42.908862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r5cf\" (UniqueName: \"kubernetes.io/projected/5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac-kube-api-access-4r5cf\") pod \"seaweedfs-64568bcd49-gnmkv\" (UID: \"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac\") " pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:43.009793 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.009722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnl2l\" (UniqueName: \"kubernetes.io/projected/28c5188e-7075-415e-b4dc-2a02940d758a-kube-api-access-jnl2l\") pod \"llmisvc-controller-manager-67d95fdc48-pvw8z\" (UID: \"28c5188e-7075-415e-b4dc-2a02940d758a\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:43.009793 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.009767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac-data\") pod \"seaweedfs-64568bcd49-gnmkv\" (UID: \"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac\") " pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:43.009958 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.009799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28c5188e-7075-415e-b4dc-2a02940d758a-cert\") pod \"llmisvc-controller-manager-67d95fdc48-pvw8z\" (UID: \"28c5188e-7075-415e-b4dc-2a02940d758a\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:43.009958 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.009822 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert\") pod \"kserve-controller-manager-666b75c8f7-jmbp5\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:43.009958 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.009877 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r5cf\" (UniqueName: \"kubernetes.io/projected/5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac-kube-api-access-4r5cf\") pod \"seaweedfs-64568bcd49-gnmkv\" (UID: \"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac\") " pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:43.009958 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.009925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf9cq\" (UniqueName: \"kubernetes.io/projected/c1bd428c-2088-4af4-99c8-f6b6fb10a639-kube-api-access-zf9cq\") pod \"kserve-controller-manager-666b75c8f7-jmbp5\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:43.010199 ip-10-0-130-141 kubenswrapper[2582]: E0707 15:03:43.009976 2582 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 07 15:03:43.010199 ip-10-0-130-141 kubenswrapper[2582]: E0707 15:03:43.010049 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert podName:c1bd428c-2088-4af4-99c8-f6b6fb10a639 nodeName:}" failed. No retries permitted until 2026-07-07 15:03:43.510028794 +0000 UTC m=+412.233930589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert") pod "kserve-controller-manager-666b75c8f7-jmbp5" (UID: "c1bd428c-2088-4af4-99c8-f6b6fb10a639") : secret "kserve-webhook-server-cert" not found Jul 07 15:03:43.010302 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.010244 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac-data\") pod \"seaweedfs-64568bcd49-gnmkv\" (UID: \"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac\") " pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:43.012320 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.012296 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28c5188e-7075-415e-b4dc-2a02940d758a-cert\") pod \"llmisvc-controller-manager-67d95fdc48-pvw8z\" (UID: \"28c5188e-7075-415e-b4dc-2a02940d758a\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:43.020822 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.020797 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnl2l\" (UniqueName: \"kubernetes.io/projected/28c5188e-7075-415e-b4dc-2a02940d758a-kube-api-access-jnl2l\") pod \"llmisvc-controller-manager-67d95fdc48-pvw8z\" (UID: \"28c5188e-7075-415e-b4dc-2a02940d758a\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:43.021186 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.021164 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r5cf\" (UniqueName: \"kubernetes.io/projected/5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac-kube-api-access-4r5cf\") pod \"seaweedfs-64568bcd49-gnmkv\" (UID: \"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac\") " pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:43.021336 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.021321 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf9cq\" (UniqueName: \"kubernetes.io/projected/c1bd428c-2088-4af4-99c8-f6b6fb10a639-kube-api-access-zf9cq\") pod \"kserve-controller-manager-666b75c8f7-jmbp5\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:43.089411 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.089369 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:43.114451 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.114427 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:43.238560 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.238534 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-pvw8z"] Jul 07 15:03:43.240241 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:03:43.240211 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod28c5188e_7075_415e_b4dc_2a02940d758a.slice/crio-91f11aa99553d508d93d7d06ce95ad5ed65b93f7640a29743861bb3bdaed6fbe WatchSource:0}: Error finding container 91f11aa99553d508d93d7d06ce95ad5ed65b93f7640a29743861bb3bdaed6fbe: Status 404 returned error can't find the container with id 91f11aa99553d508d93d7d06ce95ad5ed65b93f7640a29743861bb3bdaed6fbe Jul 07 15:03:43.266164 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.266107 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-gnmkv"] Jul 07 15:03:43.268982 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:03:43.268957 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c29711a_0ec2_4b9c_b4cd_8ed6a641d3ac.slice/crio-0c0f6346ffceba25f92d0db0c3d41d66eca095c75e182831fa41caab978f5d64 WatchSource:0}: Error finding container 0c0f6346ffceba25f92d0db0c3d41d66eca095c75e182831fa41caab978f5d64: Status 404 returned error can't find the container with id 0c0f6346ffceba25f92d0db0c3d41d66eca095c75e182831fa41caab978f5d64 Jul 07 15:03:43.514313 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.514278 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert\") pod \"kserve-controller-manager-666b75c8f7-jmbp5\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:43.516590 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.516546 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert\") pod \"kserve-controller-manager-666b75c8f7-jmbp5\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:43.676236 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.676204 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:43.790672 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.790631 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" event={"ID":"28c5188e-7075-415e-b4dc-2a02940d758a","Type":"ContainerStarted","Data":"91f11aa99553d508d93d7d06ce95ad5ed65b93f7640a29743861bb3bdaed6fbe"} Jul 07 15:03:43.793598 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.793565 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-gnmkv" event={"ID":"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac","Type":"ContainerStarted","Data":"0c0f6346ffceba25f92d0db0c3d41d66eca095c75e182831fa41caab978f5d64"} Jul 07 15:03:43.826009 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:43.825983 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-jmbp5"] Jul 07 15:03:43.890338 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:03:43.890303 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bd428c_2088_4af4_99c8_f6b6fb10a639.slice/crio-25f0492265fc73480f3d99582c4085a68f4c3cda2d172bfeb31ccc221b53ab90 WatchSource:0}: Error finding container 25f0492265fc73480f3d99582c4085a68f4c3cda2d172bfeb31ccc221b53ab90: Status 404 returned error can't find the container with id 25f0492265fc73480f3d99582c4085a68f4c3cda2d172bfeb31ccc221b53ab90 Jul 07 15:03:44.802751 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:44.802679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" event={"ID":"c1bd428c-2088-4af4-99c8-f6b6fb10a639","Type":"ContainerStarted","Data":"25f0492265fc73480f3d99582c4085a68f4c3cda2d172bfeb31ccc221b53ab90"} Jul 07 15:03:47.817606 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:47.817525 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" event={"ID":"c1bd428c-2088-4af4-99c8-f6b6fb10a639","Type":"ContainerStarted","Data":"7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9"} Jul 07 15:03:47.818022 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:47.817632 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:03:47.818997 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:47.818977 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-gnmkv" event={"ID":"5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac","Type":"ContainerStarted","Data":"c63a8d8e916e04cebe3e36ee8ae5201ec55cfcd54af934ccbdbe9b6cee54abef"} Jul 07 15:03:47.819107 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:47.819096 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:47.838676 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:47.838615 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" podStartSLOduration=2.399135517 podStartE2EDuration="5.838602984s" totalImagesPullingTime="3.439467467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:03:47.837134826 +0000 UTC m=+416.561036644" watchObservedRunningTime="2026-07-07 15:03:47.838602984 +0000 UTC m=+416.562504808" Jul 07 15:03:47.855634 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:47.855594 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-gnmkv" podStartSLOduration=1.7315257929999999 podStartE2EDuration="5.855581416s" totalImagesPullingTime="4.124055623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:03:47.854478641 +0000 UTC m=+416.578380470" watchObservedRunningTime="2026-07-07 15:03:47.855581416 +0000 UTC m=+416.579483212" Jul 07 15:03:53.829031 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:53.829004 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-gnmkv" Jul 07 15:03:58.870308 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:58.870222 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" event={"ID":"28c5188e-7075-415e-b4dc-2a02940d758a","Type":"ContainerStarted","Data":"e8fbc1abf302e488b687f14f92938be0cca7c4473b03d9ba4ea30cf7d4839657"} Jul 07 15:03:58.870651 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:58.870346 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:03:58.892667 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:03:58.892620 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" podStartSLOduration=1.62904938 podStartE2EDuration="16.892607002s" totalImagesPullingTime="15.263557622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:03:58.892007687 +0000 UTC m=+427.615909506" watchObservedRunningTime="2026-07-07 15:03:58.892607002 +0000 UTC m=+427.616508819" Jul 07 15:04:18.831407 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:18.831334 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:04:29.876918 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:29.876885 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-pvw8z" Jul 07 15:04:31.663462 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.663424 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-jmbp5"] Jul 07 15:04:31.663913 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.663697 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" podUID="c1bd428c-2088-4af4-99c8-f6b6fb10a639" containerName="manager" containerID="cri-o://7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9" gracePeriod=10 Jul 07 15:04:31.696342 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.696319 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-sqnz5"] Jul 07 15:04:31.698254 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.698238 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:31.715309 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.715287 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-sqnz5"] Jul 07 15:04:31.795965 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.795927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74k7\" (UniqueName: \"kubernetes.io/projected/c0baebde-8895-44ae-9d7c-35dfa6fa756a-kube-api-access-b74k7\") pod \"kserve-controller-manager-666b75c8f7-sqnz5\" (UID: \"c0baebde-8895-44ae-9d7c-35dfa6fa756a\") " pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:31.796097 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.795965 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0baebde-8895-44ae-9d7c-35dfa6fa756a-cert\") pod \"kserve-controller-manager-666b75c8f7-sqnz5\" (UID: \"c0baebde-8895-44ae-9d7c-35dfa6fa756a\") " pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:31.897449 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.897420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b74k7\" (UniqueName: \"kubernetes.io/projected/c0baebde-8895-44ae-9d7c-35dfa6fa756a-kube-api-access-b74k7\") pod \"kserve-controller-manager-666b75c8f7-sqnz5\" (UID: \"c0baebde-8895-44ae-9d7c-35dfa6fa756a\") " pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:31.897545 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.897465 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0baebde-8895-44ae-9d7c-35dfa6fa756a-cert\") pod \"kserve-controller-manager-666b75c8f7-sqnz5\" (UID: \"c0baebde-8895-44ae-9d7c-35dfa6fa756a\") " pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:31.899608 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.899585 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0baebde-8895-44ae-9d7c-35dfa6fa756a-cert\") pod \"kserve-controller-manager-666b75c8f7-sqnz5\" (UID: \"c0baebde-8895-44ae-9d7c-35dfa6fa756a\") " pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:31.909275 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.909252 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:04:31.920470 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.920424 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74k7\" (UniqueName: \"kubernetes.io/projected/c0baebde-8895-44ae-9d7c-35dfa6fa756a-kube-api-access-b74k7\") pod \"kserve-controller-manager-666b75c8f7-sqnz5\" (UID: \"c0baebde-8895-44ae-9d7c-35dfa6fa756a\") " pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:31.997733 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.997708 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf9cq\" (UniqueName: \"kubernetes.io/projected/c1bd428c-2088-4af4-99c8-f6b6fb10a639-kube-api-access-zf9cq\") pod \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " Jul 07 15:04:31.997863 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.997790 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert\") pod \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\" (UID: \"c1bd428c-2088-4af4-99c8-f6b6fb10a639\") " Jul 07 15:04:31.999727 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.999697 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bd428c-2088-4af4-99c8-f6b6fb10a639-kube-api-access-zf9cq" (OuterVolumeSpecName: "kube-api-access-zf9cq") pod "c1bd428c-2088-4af4-99c8-f6b6fb10a639" (UID: "c1bd428c-2088-4af4-99c8-f6b6fb10a639"). InnerVolumeSpecName "kube-api-access-zf9cq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:04:31.999727 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:31.999700 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert" (OuterVolumeSpecName: "cert") pod "c1bd428c-2088-4af4-99c8-f6b6fb10a639" (UID: "c1bd428c-2088-4af4-99c8-f6b6fb10a639"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:04:32.004097 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.004050 2582 generic.go:356] "Generic (PLEG): container finished" podID="c1bd428c-2088-4af4-99c8-f6b6fb10a639" containerID="7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9" exitCode=0 Jul 07 15:04:32.004188 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.004091 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" event={"ID":"c1bd428c-2088-4af4-99c8-f6b6fb10a639","Type":"ContainerDied","Data":"7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9"} Jul 07 15:04:32.004188 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.004109 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" Jul 07 15:04:32.004188 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.004142 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-666b75c8f7-jmbp5" event={"ID":"c1bd428c-2088-4af4-99c8-f6b6fb10a639","Type":"ContainerDied","Data":"25f0492265fc73480f3d99582c4085a68f4c3cda2d172bfeb31ccc221b53ab90"} Jul 07 15:04:32.004188 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.004164 2582 scope.go:117] "RemoveContainer" containerID="7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9" Jul 07 15:04:32.012930 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.012915 2582 scope.go:117] "RemoveContainer" containerID="7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9" Jul 07 15:04:32.013244 ip-10-0-130-141 kubenswrapper[2582]: E0707 15:04:32.013226 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9\": container with ID starting with 7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9 not found: ID does not exist" containerID="7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9" Jul 07 15:04:32.013301 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.013251 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9"} err="failed to get container status \"7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9\": rpc error: code = NotFound desc = could not find container \"7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9\": container with ID starting with 7f850828d9301aaa8a197e2637c48ac844b44accb40945b4531e33b4552024e9 not found: ID does not exist" Jul 07 15:04:32.029734 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.029713 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-jmbp5"] Jul 07 15:04:32.042002 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.041983 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-jmbp5"] Jul 07 15:04:32.044820 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.044805 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:32.099159 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.099106 2582 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1bd428c-2088-4af4-99c8-f6b6fb10a639-cert\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:04:32.099159 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.099135 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf9cq\" (UniqueName: \"kubernetes.io/projected/c1bd428c-2088-4af4-99c8-f6b6fb10a639-kube-api-access-zf9cq\") on node \"ip-10-0-130-141.ec2.internal\" DevicePath \"\"" Jul 07 15:04:32.174532 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:32.174461 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-666b75c8f7-sqnz5"] Jul 07 15:04:32.177783 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:04:32.177754 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0baebde_8895_44ae_9d7c_35dfa6fa756a.slice/crio-e762a137c19664422f3f7943a4804f6833a730a3d6ceeaf5167b11af4c860663 WatchSource:0}: Error finding container e762a137c19664422f3f7943a4804f6833a730a3d6ceeaf5167b11af4c860663: Status 404 returned error can't find the container with id e762a137c19664422f3f7943a4804f6833a730a3d6ceeaf5167b11af4c860663 Jul 07 15:04:33.009381 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:33.009306 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" event={"ID":"c0baebde-8895-44ae-9d7c-35dfa6fa756a","Type":"ContainerStarted","Data":"c3478fad57bcaebf86be552c99dca8e2f237eeedd2f7ac8b21bf4765e1ee5598"} Jul 07 15:04:33.009381 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:33.009354 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:04:33.009381 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:33.009370 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" event={"ID":"c0baebde-8895-44ae-9d7c-35dfa6fa756a","Type":"ContainerStarted","Data":"e762a137c19664422f3f7943a4804f6833a730a3d6ceeaf5167b11af4c860663"} Jul 07 15:04:33.029936 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:33.029888 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" podStartSLOduration=1.346140457 podStartE2EDuration="2.029872914s" totalImagesPullingTime="683.732457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:04:33.028944628 +0000 UTC m=+461.752846447" watchObservedRunningTime="2026-07-07 15:04:33.029872914 +0000 UTC m=+461.753774732" Jul 07 15:04:33.989672 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:04:33.989638 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bd428c-2088-4af4-99c8-f6b6fb10a639" path="/var/lib/kubelet/pods/c1bd428c-2088-4af4-99c8-f6b6fb10a639/volumes" Jul 07 15:05:04.018616 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:04.018586 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-666b75c8f7-sqnz5" Jul 07 15:05:05.423422 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.423390 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-pr5w8"] Jul 07 15:05:05.423800 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.423701 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bd428c-2088-4af4-99c8-f6b6fb10a639" containerName="manager" Jul 07 15:05:05.423800 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.423712 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bd428c-2088-4af4-99c8-f6b6fb10a639" containerName="manager" Jul 07 15:05:05.423800 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.423764 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1bd428c-2088-4af4-99c8-f6b6fb10a639" containerName="manager" Jul 07 15:05:05.427943 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.427924 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.431839 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.431819 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-l7gmg\"" Jul 07 15:05:05.432262 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.432245 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 07 15:05:05.450103 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.450081 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-pr5w8"] Jul 07 15:05:05.552794 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.552770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9-tls-certs\") pod \"model-serving-api-fd65d7d6-pr5w8\" (UID: \"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9\") " pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.552935 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.552808 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8f5c\" (UniqueName: \"kubernetes.io/projected/b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9-kube-api-access-c8f5c\") pod \"model-serving-api-fd65d7d6-pr5w8\" (UID: \"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9\") " pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.653476 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.653449 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9-tls-certs\") pod \"model-serving-api-fd65d7d6-pr5w8\" (UID: \"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9\") " pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.653635 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.653488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8f5c\" (UniqueName: \"kubernetes.io/projected/b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9-kube-api-access-c8f5c\") pod \"model-serving-api-fd65d7d6-pr5w8\" (UID: \"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9\") " pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.655882 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.655858 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9-tls-certs\") pod \"model-serving-api-fd65d7d6-pr5w8\" (UID: \"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9\") " pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.663595 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.663567 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8f5c\" (UniqueName: \"kubernetes.io/projected/b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9-kube-api-access-c8f5c\") pod \"model-serving-api-fd65d7d6-pr5w8\" (UID: \"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9\") " pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.739616 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.739555 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:05.883945 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:05.883918 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-pr5w8"] Jul 07 15:05:05.885595 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:05:05.885572 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3aa44b6_fbcb_40b4_9e2a_4bc04e1783b9.slice/crio-44d09669ba4d8839a7dc63ff539880df65e6dcf116f47a891c6ebdd8f7d0f8f4 WatchSource:0}: Error finding container 44d09669ba4d8839a7dc63ff539880df65e6dcf116f47a891c6ebdd8f7d0f8f4: Status 404 returned error can't find the container with id 44d09669ba4d8839a7dc63ff539880df65e6dcf116f47a891c6ebdd8f7d0f8f4 Jul 07 15:05:06.151121 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:06.151086 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-pr5w8" event={"ID":"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9","Type":"ContainerStarted","Data":"44d09669ba4d8839a7dc63ff539880df65e6dcf116f47a891c6ebdd8f7d0f8f4"} Jul 07 15:05:08.163076 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:08.163042 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-pr5w8" event={"ID":"b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9","Type":"ContainerStarted","Data":"df331cff8708aa1c8082fb64ff75e430c5b4bfa843f32d992ac5492aa105048a"} Jul 07 15:05:08.163429 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:08.163206 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:05:08.189461 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:08.189419 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-pr5w8" podStartSLOduration=1.099748897 podStartE2EDuration="3.189405831s" totalImagesPullingTime="2.089656934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:08.188689877 +0000 UTC m=+496.912591695" watchObservedRunningTime="2026-07-07 15:05:08.189405831 +0000 UTC m=+496.913307648" Jul 07 15:05:19.171914 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:05:19.171883 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-pr5w8" Jul 07 15:06:51.740086 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:06:51.740044 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:06:51.741189 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:06:51.741170 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:06:51.746922 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:06:51.746904 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:06:51.748194 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:06:51.748176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:11:51.766356 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:11:51.766277 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:11:51.766356 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:11:51.766324 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:11:51.775743 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:11:51.775720 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:11:51.775900 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:11:51.775808 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:16:51.795203 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:16:51.795127 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:16:51.797329 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:16:51.797307 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:16:51.801500 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:16:51.801479 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:16:51.803889 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:16:51.803871 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:21:51.819337 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:21:51.819306 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:21:51.823183 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:21:51.823160 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:21:51.825961 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:21:51.825942 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:21:51.830118 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:21:51.830101 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:23:01.345485 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:01.345446 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mnjnx_2b611955-d7ce-493b-8d46-dcf31815c4bc/global-pull-secret-syncer/0.log" Jul 07 15:23:01.480606 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:01.480574 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d27k9_c64f8801-c808-4e22-b18f-c73cb691cb11/konnectivity-agent/0.log" Jul 07 15:23:01.538272 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:01.538241 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-141.ec2.internal_6245624462c264761e6bc0bdfd40a9df/haproxy/0.log" Jul 07 15:23:06.428259 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:06.428228 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzx5j_218fe3c8-053f-4fb7-9d67-59b6e4c2b634/node-exporter/0.log" Jul 07 15:23:06.450798 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:06.450778 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzx5j_218fe3c8-053f-4fb7-9d67-59b6e4c2b634/kube-rbac-proxy/0.log" Jul 07 15:23:06.472527 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:06.472502 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzx5j_218fe3c8-053f-4fb7-9d67-59b6e4c2b634/init-textfile/0.log" Jul 07 15:23:08.500194 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:08.500158 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-qchp5_23a0759d-c277-45bd-83af-c9c1c6a4d439/networking-console-plugin/0.log" Jul 07 15:23:09.001152 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.001119 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/1.log" Jul 07 15:23:09.009631 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.009589 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2h9nl_59e13c22-43a5-483c-8a1b-9ce8c804c107/console-operator/2.log" Jul 07 15:23:09.432107 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.432076 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-769f6b5f74-xxrc5_32eb5acb-e3d8-44e4-a750-49de5d3bacd1/console/0.log" Jul 07 15:23:09.465912 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.465880 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-rmvds_fce1f29a-9371-4b49-a0de-93df46c6a4e3/download-server/0.log" Jul 07 15:23:09.710257 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.710181 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr"] Jul 07 15:23:09.713386 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.713369 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.716793 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.716763 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tv5km\"/\"default-dockercfg-lljgq\"" Jul 07 15:23:09.716921 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.716803 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tv5km\"/\"kube-root-ca.crt\"" Jul 07 15:23:09.716921 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.716814 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tv5km\"/\"openshift-service-ca.crt\"" Jul 07 15:23:09.729520 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.729498 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr"] Jul 07 15:23:09.779947 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.779916 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-proc\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.780132 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.780009 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-lib-modules\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.780132 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.780039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-podres\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.780132 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.780077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-sys\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.780242 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.780148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dm79\" (UniqueName: \"kubernetes.io/projected/87e6ebb9-b833-41f6-94cd-3d477626d9de-kube-api-access-6dm79\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881468 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-proc\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881652 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-lib-modules\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881652 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-podres\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881652 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881537 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-sys\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881652 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm79\" (UniqueName: \"kubernetes.io/projected/87e6ebb9-b833-41f6-94cd-3d477626d9de-kube-api-access-6dm79\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881652 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881535 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-proc\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881652 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881617 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-sys\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881652 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881635 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-lib-modules\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.881970 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.881687 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87e6ebb9-b833-41f6-94cd-3d477626d9de-podres\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:09.890555 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:09.890531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dm79\" (UniqueName: \"kubernetes.io/projected/87e6ebb9-b833-41f6-94cd-3d477626d9de-kube-api-access-6dm79\") pod \"perf-node-gather-daemonset-hjrjr\" (UID: \"87e6ebb9-b833-41f6-94cd-3d477626d9de\") " pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:10.022829 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:10.022754 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:10.142576 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:10.142544 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-g7rk2_9e798e2e-b860-4d6c-8b1e-4d35a7ca5f5a/volume-data-source-validator/0.log" Jul 07 15:23:10.152849 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:10.152827 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr"] Jul 07 15:23:10.155439 ip-10-0-130-141 kubenswrapper[2582]: W0707 15:23:10.155414 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod87e6ebb9_b833_41f6_94cd_3d477626d9de.slice/crio-8edb01ed9f22bd2f2cb6940342be7e3d5ce698d1245ac02a20f58cb825aa5290 WatchSource:0}: Error finding container 8edb01ed9f22bd2f2cb6940342be7e3d5ce698d1245ac02a20f58cb825aa5290: Status 404 returned error can't find the container with id 8edb01ed9f22bd2f2cb6940342be7e3d5ce698d1245ac02a20f58cb825aa5290 Jul 07 15:23:10.802470 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:10.802427 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" event={"ID":"87e6ebb9-b833-41f6-94cd-3d477626d9de","Type":"ContainerStarted","Data":"378d158170fbd1fa7a0262724f5c98dcbbb226e58ad9bc5e5e23cb899b8a68a9"} Jul 07 15:23:10.802850 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:10.802494 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:10.802850 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:10.802512 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" event={"ID":"87e6ebb9-b833-41f6-94cd-3d477626d9de","Type":"ContainerStarted","Data":"8edb01ed9f22bd2f2cb6940342be7e3d5ce698d1245ac02a20f58cb825aa5290"} Jul 07 15:23:10.822245 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:10.822201 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" podStartSLOduration=1.822187155 podStartE2EDuration="1.822187155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:23:10.820017822 +0000 UTC m=+1579.543919641" watchObservedRunningTime="2026-07-07 15:23:10.822187155 +0000 UTC m=+1579.546088972" Jul 07 15:23:11.116309 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:11.116232 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nxd4t_a14c5597-1d75-4ff2-8383-474cbe2efb0e/dns/0.log" Jul 07 15:23:11.141840 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:11.141819 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nxd4t_a14c5597-1d75-4ff2-8383-474cbe2efb0e/kube-rbac-proxy/0.log" Jul 07 15:23:11.239927 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:11.239901 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gdr2n_0d6cd7f9-5d3e-4942-ba66-6718a04797ed/dns-node-resolver/0.log" Jul 07 15:23:11.828089 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:11.828029 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zzp9g_5df3e50e-b9a9-4128-9af0-13c3c94d04c6/node-ca/0.log" Jul 07 15:23:13.027973 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:13.027945 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p57rc_b9caa6f1-8fe7-4116-b09f-59f6a24a802f/serve-healthcheck-canary/0.log" Jul 07 15:23:13.432958 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:13.432919 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-c5q6l_60e1a7f9-f02f-475f-b8a6-73c07aa28ef1/insights-operator/0.log" Jul 07 15:23:13.433854 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:13.433829 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-c5q6l_60e1a7f9-f02f-475f-b8a6-73c07aa28ef1/insights-operator/1.log" Jul 07 15:23:13.525756 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:13.525733 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jn94p_ae755654-5d8b-48e4-a729-9e3842df2034/kube-rbac-proxy/0.log" Jul 07 15:23:13.549032 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:13.549008 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jn94p_ae755654-5d8b-48e4-a729-9e3842df2034/exporter/0.log" Jul 07 15:23:13.569489 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:13.569466 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jn94p_ae755654-5d8b-48e4-a729-9e3842df2034/extractor/0.log" Jul 07 15:23:15.992551 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:15.992524 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-666b75c8f7-sqnz5_c0baebde-8895-44ae-9d7c-35dfa6fa756a/manager/0.log" Jul 07 15:23:16.016122 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:16.016093 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-pvw8z_28c5188e-7075-415e-b4dc-2a02940d758a/manager/0.log" Jul 07 15:23:16.037111 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:16.037083 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-pr5w8_b3aa44b6-fbcb-40b4-9e2a-4bc04e1783b9/server/0.log" Jul 07 15:23:16.213096 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:16.213048 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-gnmkv_5c29711a-0ec2-4b9c-b4cd-8ed6a641d3ac/seaweedfs/0.log" Jul 07 15:23:16.817174 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:16.817149 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tv5km/perf-node-gather-daemonset-hjrjr" Jul 07 15:23:21.081386 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:21.081296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-pjp67_05ac1f53-dadd-4aa7-a572-ef6a13523d30/kube-storage-version-migrator-operator/1.log" Jul 07 15:23:21.082929 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:21.082895 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-pjp67_05ac1f53-dadd-4aa7-a572-ef6a13523d30/kube-storage-version-migrator-operator/0.log" Jul 07 15:23:21.995612 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:21.995578 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8szxz_4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e/kube-multus-additional-cni-plugins/0.log" Jul 07 15:23:22.014896 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.014874 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8szxz_4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e/egress-router-binary-copy/0.log" Jul 07 15:23:22.034929 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.034902 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8szxz_4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e/cni-plugins/0.log" Jul 07 15:23:22.056680 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.056658 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8szxz_4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e/bond-cni-plugin/0.log" Jul 07 15:23:22.083716 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.083688 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8szxz_4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e/routeoverride-cni/0.log" Jul 07 15:23:22.104449 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.104424 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8szxz_4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e/whereabouts-cni-bincopy/0.log" Jul 07 15:23:22.123672 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.123644 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8szxz_4c9e2e49-9db9-4ddd-b22a-7b41a5505a6e/whereabouts-cni/0.log" Jul 07 15:23:22.543716 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.543682 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xmlfj_3b4f4f10-4697-4922-a85b-db05334e39fa/kube-multus/0.log" Jul 07 15:23:22.653548 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.653522 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jhpg5_b10826e0-c841-4537-a855-18fd4d6ba933/network-metrics-daemon/0.log" Jul 07 15:23:22.672190 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:22.672162 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jhpg5_b10826e0-c841-4537-a855-18fd4d6ba933/kube-rbac-proxy/0.log" Jul 07 15:23:23.434708 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.434668 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-controller/0.log" Jul 07 15:23:23.454786 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.454736 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/0.log" Jul 07 15:23:23.454948 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.454831 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovn-acl-logging/1.log" Jul 07 15:23:23.477954 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.477927 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/kube-rbac-proxy-node/0.log" Jul 07 15:23:23.500033 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.500005 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 15:23:23.521682 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.521652 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/northd/0.log" Jul 07 15:23:23.546080 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.546039 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/nbdb/0.log" Jul 07 15:23:23.573008 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.572979 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/sbdb/0.log" Jul 07 15:23:23.634752 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:23.634720 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nq8wm_571df583-610b-4655-8dde-1c579bbbc2be/ovnkube-controller/0.log" Jul 07 15:23:25.299037 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:25.299008 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-w4xx7_e4f09655-f9fb-41bb-82da-0c0b09922f88/check-endpoints/0.log" Jul 07 15:23:25.359498 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:25.359472 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q8n52_596f38b8-78a0-4915-bf9f-f8caed7e4238/network-check-target-container/0.log" Jul 07 15:23:26.515947 ip-10-0-130-141 kubenswrapper[2582]: I0707 15:23:26.515908 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qwfgt_d6399bef-6d74-4bcc-b53d-41b4dc6e2d01/iptables-alerter/0.log"