Jul 01 18:37:18.295932 ip-10-0-141-230 systemd[1]: Starting Kubernetes Kubelet... Jul 01 18:37:19.716769 ip-10-0-141-230 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:37:19.716769 ip-10-0-141-230 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 18:37:19.716769 ip-10-0-141-230 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:37:19.716769 ip-10-0-141-230 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 18:37:19.716769 ip-10-0-141-230 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:37:19.717889 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.717758 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 18:37:19.722969 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722948 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:37:19.722969 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722968 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722973 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722976 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722980 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722984 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722987 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722990 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722993 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722996 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.722999 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723002 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723005 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723008 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723011 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723014 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723017 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723020 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723023 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723027 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:37:19.723047 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723031 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723036 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723040 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723043 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723046 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723049 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723052 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723055 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723058 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723061 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723065 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723067 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723070 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723073 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723076 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723079 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723082 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723084 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723087 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723090 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:37:19.723507 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723093 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723096 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723098 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723102 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723105 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723107 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723110 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723114 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723116 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723119 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723123 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723126 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723128 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723131 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723135 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723138 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723141 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723143 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723146 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:37:19.724032 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723151 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723991 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.723998 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724001 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724004 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724008 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724011 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724014 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724018 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724020 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724023 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724026 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724030 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724032 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724035 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724039 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724042 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724045 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724048 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724051 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:37:19.724514 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724054 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724058 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724061 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724064 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724067 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724069 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724074 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724078 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724081 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724085 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724088 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724091 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724093 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724096 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724100 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724103 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724106 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724109 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724112 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:37:19.725025 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724115 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724942 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724950 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724953 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724956 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724959 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724963 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724966 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724969 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724972 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724974 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724978 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724981 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724984 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724987 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724990 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724992 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724995 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.724998 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:37:19.725511 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725001 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725005 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725008 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725011 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725014 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725017 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725019 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725022 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725025 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725028 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725031 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725034 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725037 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725040 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725043 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725046 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725049 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725052 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725055 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725058 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:37:19.726029 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725061 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725064 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725066 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725069 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725072 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725074 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725077 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725080 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725082 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725085 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725088 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725092 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725095 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725097 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725100 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725104 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725107 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725110 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725113 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725115 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:37:19.726545 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725118 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725121 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725123 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725128 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725132 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725136 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725140 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725143 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725146 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725149 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725153 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725156 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725159 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725163 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725167 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725170 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725172 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725175 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725178 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:37:19.727068 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725181 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725183 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725186 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725189 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725192 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725195 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725198 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725207 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725211 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725214 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725217 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725220 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725222 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725225 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725230 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725234 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725237 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725240 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725245 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:37:19.727577 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725248 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725253 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725256 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725776 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725783 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725786 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725790 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725795 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725798 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725801 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725803 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725806 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725809 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725812 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725814 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725818 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725822 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725825 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725828 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:37:19.728093 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725830 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725833 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725837 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725840 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725842 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725846 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725849 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725851 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725854 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725857 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725860 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725863 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725865 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725868 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725872 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725874 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725879 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725882 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725886 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725889 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:37:19.728655 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725892 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725896 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725899 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725902 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725905 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725908 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725910 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725913 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725916 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725919 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725922 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725925 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725928 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725931 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725936 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725939 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725942 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725945 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725948 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725951 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:37:19.729223 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725953 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725956 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725959 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725961 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725964 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725967 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725970 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725973 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725976 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725978 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725981 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725984 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725987 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725990 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725993 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725995 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.725998 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726002 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726005 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726007 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:37:19.729747 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726010 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726013 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726015 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726018 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726020 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726023 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726029 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726032 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726035 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726038 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726041 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726043 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726046 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726049 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726052 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726055 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726059 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726062 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726067 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:37:19.730298 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726070 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726073 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726076 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726079 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726184 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726193 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726200 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726206 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726211 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726215 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726220 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726224 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726228 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726231 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726235 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726238 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726242 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726245 2565 flags.go:64] FLAG: --cgroup-root="" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726248 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726255 2565 flags.go:64] FLAG: --client-ca-file="" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726258 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726261 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726265 2565 flags.go:64] FLAG: --cluster-domain="" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726268 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 18:37:19.730807 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726272 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726276 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726280 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726284 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726287 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726291 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726295 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726299 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726303 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726306 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726309 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726312 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726318 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726321 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726325 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726328 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726331 2565 flags.go:64] FLAG: --enable-server="true" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726338 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726343 2565 flags.go:64] FLAG: --event-burst="100" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726346 2565 flags.go:64] FLAG: --event-qps="50" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726349 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726353 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726356 2565 flags.go:64] FLAG: --eviction-hard="" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726360 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 18:37:19.731411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726363 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726366 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726370 2565 flags.go:64] FLAG: --eviction-soft="" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726375 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726378 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726381 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726384 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726388 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726391 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726394 2565 flags.go:64] FLAG: --feature-gates="" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726401 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726405 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726408 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726411 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726414 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726419 2565 flags.go:64] FLAG: --help="false" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726422 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-141-230.ec2.internal" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726426 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726429 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726433 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726436 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726440 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726443 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 18:37:19.732047 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726446 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726449 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726452 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726456 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726460 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726463 2565 flags.go:64] FLAG: --kube-reserved="" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726466 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726469 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726472 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726475 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726479 2565 flags.go:64] FLAG: --lock-file="" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726482 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726486 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726489 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726495 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726498 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726502 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726505 2565 flags.go:64] FLAG: --logging-format="text" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726508 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726511 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726515 2565 flags.go:64] FLAG: --manifest-url="" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726518 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726523 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726526 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726531 2565 flags.go:64] FLAG: --max-pods="110" Jul 01 18:37:19.732663 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726535 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726538 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726541 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726545 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726548 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726551 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726555 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726563 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726567 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726570 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726573 2565 flags.go:64] FLAG: --pod-cidr="" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726577 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726584 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726587 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726590 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726593 2565 flags.go:64] FLAG: --port="10250" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726597 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726600 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0263ad8099c480df4" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726603 2565 flags.go:64] FLAG: --qos-reserved="" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726606 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726610 2565 flags.go:64] FLAG: --register-node="true" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726613 2565 flags.go:64] FLAG: --register-with-taints="" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726617 2565 flags.go:64] FLAG: --registry-burst="10" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726620 2565 flags.go:64] FLAG: --registry-qps="5" Jul 01 18:37:19.733332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726623 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726626 2565 flags.go:64] FLAG: --reserved-memory="" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726630 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726633 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726636 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726639 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726642 2565 flags.go:64] FLAG: --runonce="false" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726647 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726650 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726653 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726656 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726659 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726663 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726666 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726670 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726673 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726676 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726679 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726682 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726686 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726705 2565 flags.go:64] FLAG: --system-cgroups="" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726708 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726715 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726718 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726721 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 18:37:19.733963 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726725 2565 flags.go:64] FLAG: --tls-min-version="" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726729 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726732 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726735 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726738 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726742 2565 flags.go:64] FLAG: --v="2" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726746 2565 flags.go:64] FLAG: --version="false" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726751 2565 flags.go:64] FLAG: --vmodule="" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726755 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.726758 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726907 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726912 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726915 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726918 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726923 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726927 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726929 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726932 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726935 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726937 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726940 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:37:19.735128 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726942 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726945 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726948 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726950 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726953 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726956 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726959 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726962 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726966 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726970 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726974 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726977 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726980 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726983 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726986 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726989 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726991 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726994 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726996 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:37:19.736129 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.726999 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727002 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727005 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727008 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727010 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727013 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727017 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727020 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727023 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727025 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727028 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727031 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727034 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727037 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727039 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727042 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727045 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727048 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727051 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727053 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:37:19.737137 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727056 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727059 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727062 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727065 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727068 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727071 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727074 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727076 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727079 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727082 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727085 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727087 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727090 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727093 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727096 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727098 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727101 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727105 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727110 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727113 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:37:19.738064 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727116 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727119 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727122 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727124 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727127 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727130 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727132 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727135 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727137 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727140 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727143 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727145 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727148 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727151 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727156 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727159 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727161 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727164 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727167 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727170 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:37:19.738996 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727173 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727176 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727179 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727182 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727186 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727189 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727192 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727195 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.727198 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.728014 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.737370 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.737401 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.737427 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.737441 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 18:37:19.739875 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737546 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737556 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737561 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737567 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737572 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737577 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737582 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737587 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737595 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737602 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737607 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737612 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737617 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737622 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737628 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737632 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737637 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737642 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737646 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:37:19.740435 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737651 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737655 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737660 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737664 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737669 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737674 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737678 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737682 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737686 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737712 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737728 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737733 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737738 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737745 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737750 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737755 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737761 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737766 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737771 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:37:19.741127 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737775 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737780 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737784 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737789 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737794 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737798 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737802 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737807 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737811 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737816 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737821 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737825 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737834 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737839 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737844 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737848 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737853 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737858 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:37:19.741634 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737862 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737867 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737871 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737875 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737881 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737897 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737902 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737907 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737912 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737917 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737921 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737926 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737930 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737937 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737944 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737949 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737953 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737958 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737962 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737967 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:37:19.742252 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737972 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737976 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737982 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737987 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737991 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.737996 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738001 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738005 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738010 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738014 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738019 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738024 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738032 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738036 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738041 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738046 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738051 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738055 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738069 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738073 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738077 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:37:19.742863 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738081 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.738090 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738343 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738352 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738357 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738362 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738368 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738372 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738377 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738382 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738387 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738392 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738396 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738401 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738406 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:37:19.743429 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738410 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738415 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738420 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738424 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738429 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738434 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738438 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738442 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738446 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738451 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738456 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738460 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738465 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738469 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738474 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738487 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738492 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738496 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738501 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738505 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:37:19.743854 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738510 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738514 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738519 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738523 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738527 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738532 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738536 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738541 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738546 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738551 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738556 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738560 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738564 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738569 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738574 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738578 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738583 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738587 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738592 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738596 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:37:19.744447 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738600 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738605 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738609 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738614 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738619 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738625 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738630 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738643 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738656 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738661 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738666 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738671 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738675 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738679 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738709 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738714 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738721 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738727 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738732 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:37:19.745084 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738737 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738745 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738750 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738755 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738759 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738764 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738768 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738773 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738777 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738782 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738786 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738793 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738800 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738805 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738810 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738814 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738818 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738823 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738831 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:37:19.745586 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738836 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738840 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738844 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738858 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738863 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738870 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738875 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:19.738881 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.738899 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.739587 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.742384 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.743940 2565 server.go:1019] "Starting client certificate rotation" Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.744059 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:37:19.746178 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.744833 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:37:19.746759 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.746743 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:37:19.748080 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.748057 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:37:19.759184 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.759159 2565 log.go:25] "Validated CRI v1 runtime API" Jul 01 18:37:19.761705 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.761682 2565 log.go:25] "Validated CRI v1 image API" Jul 01 18:37:19.765296 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.765271 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 18:37:19.771456 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.771423 2565 fs.go:135] Filesystem UUIDs: map[55677bbd-f9a0-4a5d-bba4-96e1a9c7d50e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8b3c8ce8-234f-43fb-a4ae-87466470cd7c:/dev/nvme0n1p4] Jul 01 18:37:19.771456 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.771450 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 18:37:19.777834 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.777669 2565 manager.go:216] Machine: {Timestamp:2026-07-01 18:37:19.776161577 +0000 UTC m=+1.295940968 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102142 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb21e91c975c808936f52722b06b5 SystemUUID:ec2fb21e-91c9-75c8-0893-6f52722b06b5 BootID:1f8883dc-4682-4bd1-830a-2e24908d61ae Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:eb:a6:4d:2c:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:eb:a6:4d:2c:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:9d:99:46:a6:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 18:37:19.777834 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.777818 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 18:37:19.778035 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.777916 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 18:37:19.781087 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.781055 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 18:37:19.781295 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.781091 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-230.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 18:37:19.782633 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.782619 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 18:37:19.782713 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.782639 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 18:37:19.782713 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.782651 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:37:19.783413 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.783399 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:37:19.783720 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.783703 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:37:19.784817 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.784801 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 18:37:19.789614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.789597 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:37:19.789856 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.789842 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 18:37:19.789925 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.789885 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 01 18:37:19.789925 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.789907 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 18:37:19.790012 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.789929 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 18:37:19.790012 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.789944 2565 kubelet.go:398] "Adding apiserver pod source" Jul 01 18:37:19.790012 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.789958 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 18:37:19.790505 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.790490 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:37:19.790589 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.790515 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:37:19.794352 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.794326 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 18:37:19.796688 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.796674 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 18:37:19.796766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.796730 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 18:37:19.797497 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797485 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 18:37:19.797529 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797503 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 18:37:19.797529 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797511 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 18:37:19.797529 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797521 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797533 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797540 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797549 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797554 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797562 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797569 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797578 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 18:37:19.797614 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.797584 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 18:37:19.798340 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.798327 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 18:37:19.798340 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.798338 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 18:37:19.802108 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.802091 2565 server.go:1268] "Started kubelet" Jul 01 18:37:19.802248 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.802199 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 18:37:19.802380 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.802242 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 18:37:19.802495 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.802405 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 18:37:19.802994 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.802969 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-230.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 18:37:19.803084 ip-10-0-141-230 systemd[1]: Started Kubernetes Kubelet. Jul 01 18:37:19.803621 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.803587 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 18:37:19.803746 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.803586 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 18:37:19.806907 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.806887 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 18:37:19.821322 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.821289 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 18:37:19.821448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.821420 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 01 18:37:19.826280 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.826260 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 18:37:19.826280 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.826274 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 18:37:19.826461 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.826426 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:19.827186 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.827113 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 18:37:19.827350 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.827319 2565 factory.go:55] Registering systemd factory Jul 01 18:37:19.827350 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.827344 2565 factory.go:223] Registration of the systemd container factory successfully Jul 01 18:37:19.827493 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.827431 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 18:37:19.827709 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.827135 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 18:37:19.827844 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.827813 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 01 18:37:19.827844 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.827823 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 01 18:37:19.828068 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.828001 2565 factory.go:153] Registering CRI-O factory Jul 01 18:37:19.828068 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.828015 2565 factory.go:223] Registration of the crio container factory successfully Jul 01 18:37:19.828173 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.828072 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 18:37:19.828173 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.828104 2565 factory.go:103] Registering Raw factory Jul 01 18:37:19.828173 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.828119 2565 manager.go:1196] Started watching for new ooms in manager Jul 01 18:37:19.828922 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.827600 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e55966b7050 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.80206088 +0000 UTC m=+1.321840270,LastTimestamp:2026-07-01 18:37:19.80206088 +0000 UTC m=+1.321840270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.829441 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.829428 2565 manager.go:349] Starting recovery of all containers Jul 01 18:37:19.835407 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.835375 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 18:37:19.835407 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.835377 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 18:37:19.842271 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.842248 2565 manager.go:354] Recovery completed Jul 01 18:37:19.847616 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.847490 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:37:19.849701 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.849677 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:37:19.849816 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.849734 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:37:19.849816 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.849755 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:37:19.850386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.850370 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 18:37:19.850386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.850382 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:37:19.850386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.850387 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 18:37:19.850500 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.850408 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:37:19.851242 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.851228 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:37:19.851294 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.851253 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:37:19.851294 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.851264 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:37:19.852288 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.852220 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e5599425d11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-230.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.849700625 +0000 UTC m=+1.369480022,LastTimestamp:2026-07-01 18:37:19.849700625 +0000 UTC m=+1.369480022,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.852751 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.852734 2565 policy_none.go:49] "None policy: Start" Jul 01 18:37:19.852751 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.852753 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 18:37:19.852851 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.852765 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 18:37:19.854923 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.854912 2565 policy_none.go:47] "Start" Jul 01 18:37:19.861411 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.861316 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e5599430da4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-230.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.849745828 +0000 UTC m=+1.369525227,LastTimestamp:2026-07-01 18:37:19.849745828 +0000 UTC m=+1.369525227,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.877878 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.877776 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e559943478d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-230.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.849760653 +0000 UTC m=+1.369540043,LastTimestamp:2026-07-01 18:37:19.849760653 +0000 UTC m=+1.369540043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.887947 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-230.ec2.internal.18be3e5599425d11\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e5599425d11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-230.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.849700625 +0000 UTC m=+1.369480022,LastTimestamp:2026-07-01 18:37:19.85124078 +0000 UTC m=+1.371020171,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.893536 2565 manager.go:337] "Starting Device Plugin manager" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.893580 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.893595 2565 server.go:87] "Starting device plugin registration server" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.893981 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.893999 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.894105 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.894209 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.894217 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.894659 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.894838 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.894895 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.895111 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dkrgc" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.896309 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.896355 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.896377 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.896416 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.899350 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.899340 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-230.ec2.internal.18be3e5599430da4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e5599430da4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-230.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.849745828 +0000 UTC m=+1.369525227,LastTimestamp:2026-07-01 18:37:19.851258338 +0000 UTC m=+1.371037729,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.904953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.904247 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dkrgc" Jul 01 18:37:19.906428 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.906361 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-230.ec2.internal.18be3e559943478d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e559943478d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-230.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.849760653 +0000 UTC m=+1.369540043,LastTimestamp:2026-07-01 18:37:19.851268151 +0000 UTC m=+1.371047543,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.912441 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:19.912370 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-230.ec2.internal.18be3e559c1b321f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-230.ec2.internal,UID:ip-10-0-141-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-141-230.ec2.internal,},FirstTimestamp:2026-07-01 18:37:19.897465375 +0000 UTC m=+1.417244756,LastTimestamp:2026-07-01 18:37:19.897465375 +0000 UTC m=+1.417244756,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-230.ec2.internal,}" Jul 01 18:37:19.999383 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.999270 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:37:19.999383 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.999287 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal"] Jul 01 18:37:19.999604 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:19.999470 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:37:20.000469 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.000448 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:37:20.000562 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.000482 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:37:20.000562 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.000494 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:37:20.000562 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.000518 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.001167 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.001148 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:37:20.001242 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.001178 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:37:20.001242 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.001188 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:37:20.003661 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.003646 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:37:20.003814 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.003800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.003860 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.003839 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:37:20.004519 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.004503 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:37:20.004595 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.004534 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:37:20.004595 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.004544 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:37:20.004935 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.004921 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:37:20.004984 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.004949 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:37:20.004984 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.004965 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:37:20.007075 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.007059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.007139 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.007088 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:37:20.007921 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.007907 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:37:20.007992 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.007936 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:37:20.007992 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.007946 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:37:20.011926 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.011913 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.011988 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.011932 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-230.ec2.internal\": node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.029300 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.029270 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/116575f1223264f944dddc62291c77f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal\" (UID: \"116575f1223264f944dddc62291c77f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.029456 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.029308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/116575f1223264f944dddc62291c77f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal\" (UID: \"116575f1223264f944dddc62291c77f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.029456 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.029335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e20c26ce09867b5f1755fe9406cdab-config\") pod \"kube-apiserver-proxy-ip-10-0-141-230.ec2.internal\" (UID: \"e0e20c26ce09867b5f1755fe9406cdab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.035680 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.035662 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-230.ec2.internal\" not found" node="ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.040818 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.040801 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-230.ec2.internal\" not found" node="ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.041581 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.041565 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.129898 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.129861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/116575f1223264f944dddc62291c77f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal\" (UID: \"116575f1223264f944dddc62291c77f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.129898 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.129896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/116575f1223264f944dddc62291c77f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal\" (UID: \"116575f1223264f944dddc62291c77f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.130140 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.129915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e20c26ce09867b5f1755fe9406cdab-config\") pod \"kube-apiserver-proxy-ip-10-0-141-230.ec2.internal\" (UID: \"e0e20c26ce09867b5f1755fe9406cdab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.130140 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.129947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e20c26ce09867b5f1755fe9406cdab-config\") pod \"kube-apiserver-proxy-ip-10-0-141-230.ec2.internal\" (UID: \"e0e20c26ce09867b5f1755fe9406cdab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.130140 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.129954 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/116575f1223264f944dddc62291c77f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal\" (UID: \"116575f1223264f944dddc62291c77f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.130140 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.129986 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/116575f1223264f944dddc62291c77f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal\" (UID: \"116575f1223264f944dddc62291c77f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.141887 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.141856 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.242939 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.242898 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.338508 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.338402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.343126 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.343102 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.345514 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.345496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.443895 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.443844 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.544854 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.544810 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.645558 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.645477 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.743197 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.743154 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 18:37:20.746547 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.746526 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-230.ec2.internal\" not found" Jul 01 18:37:20.778500 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.778466 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:37:20.791039 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.791012 2565 apiserver.go:52] "Watching apiserver" Jul 01 18:37:20.803437 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.803404 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 18:37:20.803792 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.803769 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8","openshift-image-registry/node-ca-bx8tq","openshift-multus/multus-additional-cni-plugins-qb5z2","openshift-multus/multus-ns9mg","openshift-multus/network-metrics-daemon-g5l67","openshift-ovn-kubernetes/ovnkube-node-xxdj5","kube-system/global-pull-secret-syncer-wj9cb","kube-system/konnectivity-agent-qj9d4","openshift-cluster-node-tuning-operator/tuned-z6n6w","openshift-dns/node-resolver-vdl8m","openshift-network-diagnostics/network-check-target-76wtw","openshift-network-operator/iptables-alerter-rg77g"] Jul 01 18:37:20.806569 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.806547 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:20.809109 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.809085 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.809944 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.809924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qp2bb\"" Jul 01 18:37:20.809944 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.809938 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 18:37:20.810060 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.809953 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 18:37:20.811986 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.811965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.813327 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.813294 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b5fps\"" Jul 01 18:37:20.813602 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.813589 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:37:20.813675 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.813660 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 18:37:20.813846 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.813834 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 18:37:20.814823 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.814806 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 18:37:20.815029 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.815007 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 18:37:20.815158 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.815143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.816270 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.816251 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 18:37:20.816377 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.816339 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gx5nd\"" Jul 01 18:37:20.817716 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.817692 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.818085 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.818015 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 18:37:20.818576 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.818559 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 18:37:20.818686 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.818574 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 18:37:20.818686 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.818574 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfmjd\"" Jul 01 18:37:20.820201 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.820181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.821237 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.821222 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 18:37:20.821311 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.821288 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 18:37:20.822073 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.822039 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 18:37:20.822177 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.822106 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bfcm8\"" Jul 01 18:37:20.822177 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.822130 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 18:37:20.822177 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.822145 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 18:37:20.822694 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.822678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:20.822784 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.822764 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:20.823027 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.823009 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xnt2k\"" Jul 01 18:37:20.823191 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.823177 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 18:37:20.825227 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.825208 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.826974 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.826955 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 18:37:20.826974 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.826965 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.827869 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.827849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.828016 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.827935 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:20.828520 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.828489 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 18:37:20.828520 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.828505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 18:37:20.828520 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.828515 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-92xp6\"" Jul 01 18:37:20.828780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.828530 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 18:37:20.828780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.828568 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 18:37:20.828780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.828530 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 18:37:20.828918 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.828903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 18:37:20.830528 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.830510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.833197 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.833175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:20.834947 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.834904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-registration-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.835066 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.834963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-var-lib-kubelet\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.835066 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835030 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:37:20.835212 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7kx\" (UniqueName: \"kubernetes.io/projected/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-kube-api-access-jj7kx\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.835474 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-cni-binary-copy\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.835551 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysconfig\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.835551 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58nxx\" (UniqueName: \"kubernetes.io/projected/37844ed1-4709-4e55-95b1-1e29630de969-kube-api-access-58nxx\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.835721 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-system-cni-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.835721 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-cnibin\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.835721 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-multus-certs\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.835721 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-sys-fs\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.835942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.835942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/327014f6-05be-4fbe-befe-2161d2ae573e-cni-binary-copy\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.835942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-socket-dir-parent\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.835942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-cni-bin\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.835942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-env-overrides\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.835942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-sys\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.835942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-cnibin\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.836268 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.835971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.836268 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-etc-kubernetes\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-cni-bin\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.836480 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836517 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z8px5\"" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-modprobe-d\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-kubernetes\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836648 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-kubelet\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-run-netns\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-netns\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/327014f6-05be-4fbe-befe-2161d2ae573e-multus-daemon-config\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836940 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nv7jh\"" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.836970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj9jp\" (UniqueName: \"kubernetes.io/projected/e6161fdd-3d07-425a-b61d-617ba4ece3d9-kube-api-access-mj9jp\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rspzb\" (UniqueName: \"kubernetes.io/projected/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-kube-api-access-rspzb\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-host\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-var-lib-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.837247 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-systemd\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-os-release\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837648 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-conf-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bg4z\" (UniqueName: \"kubernetes.io/projected/327014f6-05be-4fbe-befe-2161d2ae573e-kube-api-access-9bg4z\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-device-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-systemd\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-cni-netd\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysctl-conf\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.837953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-hostroot\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96a58d9e-0266-4871-94ef-fc8deee52ebb-kubelet-config\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-socket-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdch2\" (UniqueName: \"kubernetes.io/projected/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-kube-api-access-gdch2\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838166 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 18:37:20.838244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.838979 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovnkube-script-lib\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.838979 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysctl-d\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.838979 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-lib-modules\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.838979 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-host\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.838979 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-tuned\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.838979 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d7vc\" (UniqueName: \"kubernetes.io/projected/0492b07f-99f0-4848-9cf5-c80d9435cf50-kube-api-access-8d7vc\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.838979 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.838493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 18:37:20.839716 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.839684 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-serviceca\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.839816 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.839768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-run\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.839875 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.839837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-tmp\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.839932 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.839889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6161fdd-3d07-425a-b61d-617ba4ece3d9-iptables-alerter-script\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.840031 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.839992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-system-cni-dir\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.840133 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-cni-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.840500 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-kubelet\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.840575 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840498 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.840575 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72755299-e3a5-41ee-9a19-2d0272fd44e0-agent-certs\") pod \"konnectivity-agent-qj9d4\" (UID: \"72755299-e3a5-41ee-9a19-2d0272fd44e0\") " pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:20.840575 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:20.840766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-ovn\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.840766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovnkube-config\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.840766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72755299-e3a5-41ee-9a19-2d0272fd44e0-konnectivity-ca\") pod \"konnectivity-agent-qj9d4\" (UID: \"72755299-e3a5-41ee-9a19-2d0272fd44e0\") " pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:20.840766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.840766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-k8s-cni-cncf-io\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.840766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96a58d9e-0266-4871-94ef-fc8deee52ebb-dbus\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.840766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovn-node-metrics-cert\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6vdg\" (UniqueName: \"kubernetes.io/projected/b18a49f5-162c-44a8-8a1f-21cc8b59d966-kube-api-access-g6vdg\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6161fdd-3d07-425a-b61d-617ba4ece3d9-host-slash\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-systemd-units\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-cni-multus\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-slash\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-etc-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-node-log\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.840996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-log-socket\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.841117 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.841014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-os-release\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.844081 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.844064 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal"] Jul 01 18:37:20.844650 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.844615 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:37:20.844992 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.844976 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:37:20.845053 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.845040 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" Jul 01 18:37:20.869918 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.869892 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal"] Jul 01 18:37:20.870066 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.869999 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:37:20.891834 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.891810 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qq9n4" Jul 01 18:37:20.910819 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.910763 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 18:32:20 +0000 UTC" deadline="2028-03-19 07:54:33.986998764 +0000 UTC" Jul 01 18:37:20.910819 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.910814 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15037h17m13.076187887s" Jul 01 18:37:20.910995 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.910832 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qq9n4" Jul 01 18:37:20.929571 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.929546 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 18:37:20.942164 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.942164 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/327014f6-05be-4fbe-befe-2161d2ae573e-cni-binary-copy\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-socket-dir-parent\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-cni-bin\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-env-overrides\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-sys\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-cnibin\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942301 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-cni-bin\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942301 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-socket-dir-parent\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-sys\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.942374 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-etc-kubernetes\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-cnibin\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-cni-bin\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942459 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-etc-kubernetes\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-modprobe-d\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942510 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-cni-bin\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-kubernetes\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-kubernetes\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-modprobe-d\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-kubelet\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-run-netns\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-netns\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-kubelet\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/327014f6-05be-4fbe-befe-2161d2ae573e-multus-daemon-config\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.942972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-run-netns\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f47f7abb-9c3d-4310-bfba-ef66564fd631-tmp-dir\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942845 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-netns\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942870 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/327014f6-05be-4fbe-befe-2161d2ae573e-cni-binary-copy\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgqc\" (UniqueName: \"kubernetes.io/projected/f47f7abb-9c3d-4310-bfba-ef66564fd631-kube-api-access-4bgqc\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942898 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj9jp\" (UniqueName: \"kubernetes.io/projected/e6161fdd-3d07-425a-b61d-617ba4ece3d9-kube-api-access-mj9jp\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rspzb\" (UniqueName: \"kubernetes.io/projected/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-kube-api-access-rspzb\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-host\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-var-lib-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.942982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-var-lib-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-host\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-systemd\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-os-release\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-conf-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.943783 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/327014f6-05be-4fbe-befe-2161d2ae573e-multus-daemon-config\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bg4z\" (UniqueName: \"kubernetes.io/projected/327014f6-05be-4fbe-befe-2161d2ae573e-kube-api-access-9bg4z\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-device-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-env-overrides\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943334 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-conf-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943341 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-systemd\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-systemd\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-cni-netd\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943379 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-os-release\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-device-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-systemd\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysctl-conf\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-cni-netd\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-hostroot\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96a58d9e-0266-4871-94ef-fc8deee52ebb-kubelet-config\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-hostroot\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.944563 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943528 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysctl-conf\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96a58d9e-0266-4871-94ef-fc8deee52ebb-kubelet-config\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-socket-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.943562 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943574 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdch2\" (UniqueName: \"kubernetes.io/projected/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-kube-api-access-gdch2\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.943629 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret podName:96a58d9e-0266-4871-94ef-fc8deee52ebb nodeName:}" failed. No retries permitted until 2026-07-01 18:37:21.443607547 +0000 UTC m=+2.963386947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret") pod "global-pull-secret-syncer-wj9cb" (UID: "96a58d9e-0266-4871-94ef-fc8deee52ebb") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovnkube-script-lib\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-socket-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysctl-d\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-lib-modules\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-host\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-tuned\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d7vc\" (UniqueName: \"kubernetes.io/projected/0492b07f-99f0-4848-9cf5-c80d9435cf50-kube-api-access-8d7vc\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-serviceca\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-host\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.945603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysctl-d\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-run\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943965 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-lib-modules\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.943974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-tmp\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6161fdd-3d07-425a-b61d-617ba4ece3d9-iptables-alerter-script\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-system-cni-dir\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-cni-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-kubelet\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-system-cni-dir\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-run\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72755299-e3a5-41ee-9a19-2d0272fd44e0-agent-certs\") pod \"konnectivity-agent-qj9d4\" (UID: \"72755299-e3a5-41ee-9a19-2d0272fd44e0\") " pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944247 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-ovn\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944304 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-multus-cni-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovnkube-config\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72755299-e3a5-41ee-9a19-2d0272fd44e0-konnectivity-ca\") pod \"konnectivity-agent-qj9d4\" (UID: \"72755299-e3a5-41ee-9a19-2d0272fd44e0\") " pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:20.946491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-k8s-cni-cncf-io\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96a58d9e-0266-4871-94ef-fc8deee52ebb-dbus\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovn-node-metrics-cert\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6vdg\" (UniqueName: \"kubernetes.io/projected/b18a49f5-162c-44a8-8a1f-21cc8b59d966-kube-api-access-g6vdg\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944521 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-serviceca\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovnkube-script-lib\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6161fdd-3d07-425a-b61d-617ba4ece3d9-host-slash\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-kubelet\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6161fdd-3d07-425a-b61d-617ba4ece3d9-host-slash\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96a58d9e-0266-4871-94ef-fc8deee52ebb-dbus\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944676 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-k8s-cni-cncf-io\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-systemd-units\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-cni-multus\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f47f7abb-9c3d-4310-bfba-ef66564fd631-hosts-file\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-slash\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.947386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-etc-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37844ed1-4709-4e55-95b1-1e29630de969-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-node-log\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6161fdd-3d07-425a-b61d-617ba4ece3d9-iptables-alerter-script\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-log-socket\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovnkube-config\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-os-release\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.944948 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945007 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-run-ovn\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.945044 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945066 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-os-release\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:20.945101 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:21.445081743 +0000 UTC m=+2.964861159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945108 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-host-slash\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945159 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-etc-openvswitch\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945195 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945205 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-node-log\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72755299-e3a5-41ee-9a19-2d0272fd44e0-konnectivity-ca\") pod \"konnectivity-agent-qj9d4\" (UID: \"72755299-e3a5-41ee-9a19-2d0272fd44e0\") " pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:20.948308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-systemd-units\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-registration-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b18a49f5-162c-44a8-8a1f-21cc8b59d966-log-socket\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-var-lib-kubelet\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7kx\" (UniqueName: \"kubernetes.io/projected/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-kube-api-access-jj7kx\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945320 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-var-lib-cni-multus\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-cni-binary-copy\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-registration-dir\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945381 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysconfig\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nxx\" (UniqueName: \"kubernetes.io/projected/37844ed1-4709-4e55-95b1-1e29630de969-kube-api-access-58nxx\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945423 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-var-lib-kubelet\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-system-cni-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-cnibin\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-multus-certs\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-sys-fs\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945669 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0492b07f-99f0-4848-9cf5-c80d9435cf50-sys-fs\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-sysconfig\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.948978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.945922 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37844ed1-4709-4e55-95b1-1e29630de969-cni-binary-copy\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.949603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.946001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-system-cni-dir\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.949603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.946067 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-cnibin\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.949603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.946113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/327014f6-05be-4fbe-befe-2161d2ae573e-host-run-multus-certs\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.949603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.947943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-tmp\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.949603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.948008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-etc-tuned\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.949603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.948079 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b18a49f5-162c-44a8-8a1f-21cc8b59d966-ovn-node-metrics-cert\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.949603 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.948284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72755299-e3a5-41ee-9a19-2d0272fd44e0-agent-certs\") pod \"konnectivity-agent-qj9d4\" (UID: \"72755299-e3a5-41ee-9a19-2d0272fd44e0\") " pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:20.961196 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.961157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rspzb\" (UniqueName: \"kubernetes.io/projected/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-kube-api-access-rspzb\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:20.961472 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.961447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdch2\" (UniqueName: \"kubernetes.io/projected/549b51a2-5ce7-4dec-b80b-ed88f88c3b1a-kube-api-access-gdch2\") pod \"node-ca-bx8tq\" (UID: \"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a\") " pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:20.961641 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.961604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj9jp\" (UniqueName: \"kubernetes.io/projected/e6161fdd-3d07-425a-b61d-617ba4ece3d9-kube-api-access-mj9jp\") pod \"iptables-alerter-rg77g\" (UID: \"e6161fdd-3d07-425a-b61d-617ba4ece3d9\") " pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:20.961641 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.961627 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d7vc\" (UniqueName: \"kubernetes.io/projected/0492b07f-99f0-4848-9cf5-c80d9435cf50-kube-api-access-8d7vc\") pod \"aws-ebs-csi-driver-node-xl2g8\" (UID: \"0492b07f-99f0-4848-9cf5-c80d9435cf50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:20.962216 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.962195 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7kx\" (UniqueName: \"kubernetes.io/projected/0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d-kube-api-access-jj7kx\") pod \"tuned-z6n6w\" (UID: \"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d\") " pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:20.962531 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.962492 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bg4z\" (UniqueName: \"kubernetes.io/projected/327014f6-05be-4fbe-befe-2161d2ae573e-kube-api-access-9bg4z\") pod \"multus-ns9mg\" (UID: \"327014f6-05be-4fbe-befe-2161d2ae573e\") " pod="openshift-multus/multus-ns9mg" Jul 01 18:37:20.962689 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.962666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6vdg\" (UniqueName: \"kubernetes.io/projected/b18a49f5-162c-44a8-8a1f-21cc8b59d966-kube-api-access-g6vdg\") pod \"ovnkube-node-xxdj5\" (UID: \"b18a49f5-162c-44a8-8a1f-21cc8b59d966\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:20.963975 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.963953 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58nxx\" (UniqueName: \"kubernetes.io/projected/37844ed1-4709-4e55-95b1-1e29630de969-kube-api-access-58nxx\") pod \"multus-additional-cni-plugins-qb5z2\" (UID: \"37844ed1-4709-4e55-95b1-1e29630de969\") " pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:20.978232 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:20.978196 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e20c26ce09867b5f1755fe9406cdab.slice/crio-b82fcbb4887da1884ead7a9c51694567564f12a18ec3d89ede3ec595aeb4206c WatchSource:0}: Error finding container b82fcbb4887da1884ead7a9c51694567564f12a18ec3d89ede3ec595aeb4206c: Status 404 returned error can't find the container with id b82fcbb4887da1884ead7a9c51694567564f12a18ec3d89ede3ec595aeb4206c Jul 01 18:37:20.978446 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:20.978426 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116575f1223264f944dddc62291c77f3.slice/crio-a6c745a4a9dda0ea1031e8d1ff0eb2f34ed6e704aeaa98ae49ccfad02ecccc1e WatchSource:0}: Error finding container a6c745a4a9dda0ea1031e8d1ff0eb2f34ed6e704aeaa98ae49ccfad02ecccc1e: Status 404 returned error can't find the container with id a6c745a4a9dda0ea1031e8d1ff0eb2f34ed6e704aeaa98ae49ccfad02ecccc1e Jul 01 18:37:20.983808 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:20.983788 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:37:21.045919 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.045872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f47f7abb-9c3d-4310-bfba-ef66564fd631-hosts-file\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:21.046127 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.045940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:21.046127 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.045966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f47f7abb-9c3d-4310-bfba-ef66564fd631-tmp-dir\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:21.046127 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.045983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgqc\" (UniqueName: \"kubernetes.io/projected/f47f7abb-9c3d-4310-bfba-ef66564fd631-kube-api-access-4bgqc\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:21.046127 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.046053 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f47f7abb-9c3d-4310-bfba-ef66564fd631-hosts-file\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:21.046395 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.046375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f47f7abb-9c3d-4310-bfba-ef66564fd631-tmp-dir\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:21.054364 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.054337 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:37:21.054364 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.054361 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:37:21.054364 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.054372 2565 projected.go:196] Error preparing data for projected volume kube-api-access-gcwgk for pod openshift-network-diagnostics/network-check-target-76wtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:21.054630 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.054435 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk podName:cb37284c-086a-4da4-ac53-95b2244e4c86 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:21.554416715 +0000 UTC m=+3.074196119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gcwgk" (UniqueName: "kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk") pod "network-check-target-76wtw" (UID: "cb37284c-086a-4da4-ac53-95b2244e4c86") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:21.056410 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.056384 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgqc\" (UniqueName: \"kubernetes.io/projected/f47f7abb-9c3d-4310-bfba-ef66564fd631-kube-api-access-4bgqc\") pod \"node-resolver-vdl8m\" (UID: \"f47f7abb-9c3d-4310-bfba-ef66564fd631\") " pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:21.135983 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.135947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:21.146376 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.146347 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72755299_e3a5_41ee_9a19_2d0272fd44e0.slice/crio-601948cc509d965128ba9b5ec5a877849e04ba0d0ff5945cc07246da5505a8aa WatchSource:0}: Error finding container 601948cc509d965128ba9b5ec5a877849e04ba0d0ff5945cc07246da5505a8aa: Status 404 returned error can't find the container with id 601948cc509d965128ba9b5ec5a877849e04ba0d0ff5945cc07246da5505a8aa Jul 01 18:37:21.155776 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.155718 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg77g" Jul 01 18:37:21.165663 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.165636 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6161fdd_3d07_425a_b61d_617ba4ece3d9.slice/crio-86d7e05a2f1fb4c6b698a8dc101d5caff6240361ac813caf6291b1b3ab00dfc0 WatchSource:0}: Error finding container 86d7e05a2f1fb4c6b698a8dc101d5caff6240361ac813caf6291b1b3ab00dfc0: Status 404 returned error can't find the container with id 86d7e05a2f1fb4c6b698a8dc101d5caff6240361ac813caf6291b1b3ab00dfc0 Jul 01 18:37:21.175075 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.175053 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" Jul 01 18:37:21.180429 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.180407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bx8tq" Jul 01 18:37:21.185599 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.185575 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0492b07f_99f0_4848_9cf5_c80d9435cf50.slice/crio-2059833b682c79b609e1a114c3cc95858188f694cc6e06685121b76df1bb58bb WatchSource:0}: Error finding container 2059833b682c79b609e1a114c3cc95858188f694cc6e06685121b76df1bb58bb: Status 404 returned error can't find the container with id 2059833b682c79b609e1a114c3cc95858188f694cc6e06685121b76df1bb58bb Jul 01 18:37:21.189879 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.189852 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549b51a2_5ce7_4dec_b80b_ed88f88c3b1a.slice/crio-172bcf91c1cb25bfed5a6be58d299464c6193a9ed99ddd242b6a68ad44c8ad7a WatchSource:0}: Error finding container 172bcf91c1cb25bfed5a6be58d299464c6193a9ed99ddd242b6a68ad44c8ad7a: Status 404 returned error can't find the container with id 172bcf91c1cb25bfed5a6be58d299464c6193a9ed99ddd242b6a68ad44c8ad7a Jul 01 18:37:21.197139 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.197117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" Jul 01 18:37:21.204029 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.204010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ns9mg" Jul 01 18:37:21.207460 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.207437 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37844ed1_4709_4e55_95b1_1e29630de969.slice/crio-258075a23e25391ad6adea9c9d12fd1e39bb23208c984ce11751a4ae7ad870ff WatchSource:0}: Error finding container 258075a23e25391ad6adea9c9d12fd1e39bb23208c984ce11751a4ae7ad870ff: Status 404 returned error can't find the container with id 258075a23e25391ad6adea9c9d12fd1e39bb23208c984ce11751a4ae7ad870ff Jul 01 18:37:21.212567 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.212546 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327014f6_05be_4fbe_befe_2161d2ae573e.slice/crio-c5abf16118c57be57f941f28c6871b7d102d44847ccb58853d66ab0bd395e16d WatchSource:0}: Error finding container c5abf16118c57be57f941f28c6871b7d102d44847ccb58853d66ab0bd395e16d: Status 404 returned error can't find the container with id c5abf16118c57be57f941f28c6871b7d102d44847ccb58853d66ab0bd395e16d Jul 01 18:37:21.229953 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.229928 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:21.239866 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.239835 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18a49f5_162c_44a8_8a1f_21cc8b59d966.slice/crio-d240880ede416aa22beae950e3018262abe7ff2b390e6fc2f7372a8ef607b12f WatchSource:0}: Error finding container d240880ede416aa22beae950e3018262abe7ff2b390e6fc2f7372a8ef607b12f: Status 404 returned error can't find the container with id d240880ede416aa22beae950e3018262abe7ff2b390e6fc2f7372a8ef607b12f Jul 01 18:37:21.247402 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.247377 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" Jul 01 18:37:21.256876 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.256851 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbb3df3_34c3_4c88_a4e5_d08b689d5e8d.slice/crio-83647fd9be490c8805478055a78c48a00f25f875a1187c5d8e5f2a47d79506e7 WatchSource:0}: Error finding container 83647fd9be490c8805478055a78c48a00f25f875a1187c5d8e5f2a47d79506e7: Status 404 returned error can't find the container with id 83647fd9be490c8805478055a78c48a00f25f875a1187c5d8e5f2a47d79506e7 Jul 01 18:37:21.258462 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.258444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vdl8m" Jul 01 18:37:21.268495 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:21.268468 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47f7abb_9c3d_4310_bfba_ef66564fd631.slice/crio-2d9cfefcd4363882586cab030c9a0cb2f9443668509e14d26a3624ee3c3dc509 WatchSource:0}: Error finding container 2d9cfefcd4363882586cab030c9a0cb2f9443668509e14d26a3624ee3c3dc509: Status 404 returned error can't find the container with id 2d9cfefcd4363882586cab030c9a0cb2f9443668509e14d26a3624ee3c3dc509 Jul 01 18:37:21.295755 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.295726 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:37:21.318481 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.318449 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:37:21.342508 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.342481 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:37:21.449974 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.449889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:21.450150 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.449986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:21.450150 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.450125 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:21.450286 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.450192 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret podName:96a58d9e-0266-4871-94ef-fc8deee52ebb nodeName:}" failed. No retries permitted until 2026-07-01 18:37:22.450172117 +0000 UTC m=+3.969951519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret") pod "global-pull-secret-syncer-wj9cb" (UID: "96a58d9e-0266-4871-94ef-fc8deee52ebb") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:21.450377 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.450364 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:21.450435 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.450409 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:22.450395513 +0000 UTC m=+3.970174908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:21.652038 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.651996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:21.652247 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.652201 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:37:21.652247 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.652226 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:37:21.652247 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.652238 2565 projected.go:196] Error preparing data for projected volume kube-api-access-gcwgk for pod openshift-network-diagnostics/network-check-target-76wtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:21.652416 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:21.652302 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk podName:cb37284c-086a-4da4-ac53-95b2244e4c86 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:22.652282331 +0000 UTC m=+4.172061708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcwgk" (UniqueName: "kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk") pod "network-check-target-76wtw" (UID: "cb37284c-086a-4da4-ac53-95b2244e4c86") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:21.913730 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.913683 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:32:21 +0000 UTC" deadline="2028-01-11 18:40:20.889345635 +0000 UTC" Jul 01 18:37:21.913730 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.913728 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13416h2m58.975623399s" Jul 01 18:37:21.937818 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.937751 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bx8tq" event={"ID":"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a","Type":"ContainerStarted","Data":"172bcf91c1cb25bfed5a6be58d299464c6193a9ed99ddd242b6a68ad44c8ad7a"} Jul 01 18:37:21.947818 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.947667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" event={"ID":"0492b07f-99f0-4848-9cf5-c80d9435cf50","Type":"ContainerStarted","Data":"2059833b682c79b609e1a114c3cc95858188f694cc6e06685121b76df1bb58bb"} Jul 01 18:37:21.968670 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.968558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" event={"ID":"e0e20c26ce09867b5f1755fe9406cdab","Type":"ContainerStarted","Data":"b82fcbb4887da1884ead7a9c51694567564f12a18ec3d89ede3ec595aeb4206c"} Jul 01 18:37:21.970898 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.970866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"d240880ede416aa22beae950e3018262abe7ff2b390e6fc2f7372a8ef607b12f"} Jul 01 18:37:21.980411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:21.980373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ns9mg" event={"ID":"327014f6-05be-4fbe-befe-2161d2ae573e","Type":"ContainerStarted","Data":"c5abf16118c57be57f941f28c6871b7d102d44847ccb58853d66ab0bd395e16d"} Jul 01 18:37:22.006844 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.005281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerStarted","Data":"258075a23e25391ad6adea9c9d12fd1e39bb23208c984ce11751a4ae7ad870ff"} Jul 01 18:37:22.012714 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.012657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg77g" event={"ID":"e6161fdd-3d07-425a-b61d-617ba4ece3d9","Type":"ContainerStarted","Data":"86d7e05a2f1fb4c6b698a8dc101d5caff6240361ac813caf6291b1b3ab00dfc0"} Jul 01 18:37:22.020884 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.020843 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qj9d4" event={"ID":"72755299-e3a5-41ee-9a19-2d0272fd44e0","Type":"ContainerStarted","Data":"601948cc509d965128ba9b5ec5a877849e04ba0d0ff5945cc07246da5505a8aa"} Jul 01 18:37:22.042041 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.041946 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" event={"ID":"116575f1223264f944dddc62291c77f3","Type":"ContainerStarted","Data":"a6c745a4a9dda0ea1031e8d1ff0eb2f34ed6e704aeaa98ae49ccfad02ecccc1e"} Jul 01 18:37:22.074894 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.074851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vdl8m" event={"ID":"f47f7abb-9c3d-4310-bfba-ef66564fd631","Type":"ContainerStarted","Data":"2d9cfefcd4363882586cab030c9a0cb2f9443668509e14d26a3624ee3c3dc509"} Jul 01 18:37:22.090738 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.090638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" event={"ID":"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d","Type":"ContainerStarted","Data":"83647fd9be490c8805478055a78c48a00f25f875a1187c5d8e5f2a47d79506e7"} Jul 01 18:37:22.459596 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.459532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:22.459596 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.459599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:22.459854 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.459742 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:22.459854 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.459812 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:24.459789425 +0000 UTC m=+5.979568818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:22.460003 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.459882 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:22.460003 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.459918 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret podName:96a58d9e-0266-4871-94ef-fc8deee52ebb nodeName:}" failed. No retries permitted until 2026-07-01 18:37:24.459905713 +0000 UTC m=+5.979685110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret") pod "global-pull-secret-syncer-wj9cb" (UID: "96a58d9e-0266-4871-94ef-fc8deee52ebb") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:22.660514 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.660469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:22.660729 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.660681 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:37:22.660729 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.660706 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:37:22.660729 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.660723 2565 projected.go:196] Error preparing data for projected volume kube-api-access-gcwgk for pod openshift-network-diagnostics/network-check-target-76wtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:22.660919 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.660790 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk podName:cb37284c-086a-4da4-ac53-95b2244e4c86 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:24.660770554 +0000 UTC m=+6.180549945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcwgk" (UniqueName: "kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk") pod "network-check-target-76wtw" (UID: "cb37284c-086a-4da4-ac53-95b2244e4c86") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:22.897198 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.897169 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:22.897398 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.897310 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:22.897474 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.897412 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:22.897528 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.897502 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:22.897587 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.897571 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:22.897677 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:22.897655 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:22.914310 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.914235 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:32:21 +0000 UTC" deadline="2028-04-14 03:48:15.291216072 +0000 UTC" Jul 01 18:37:22.914310 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:22.914303 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15657h10m52.376917629s" Jul 01 18:37:24.476064 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:24.476020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:24.476562 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:24.476087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:24.476562 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.476271 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:24.476562 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.476342 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:28.476320386 +0000 UTC m=+9.996099788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:24.477161 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.476793 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:24.477161 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.476853 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret podName:96a58d9e-0266-4871-94ef-fc8deee52ebb nodeName:}" failed. No retries permitted until 2026-07-01 18:37:28.476836201 +0000 UTC m=+9.996615579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret") pod "global-pull-secret-syncer-wj9cb" (UID: "96a58d9e-0266-4871-94ef-fc8deee52ebb") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:24.678772 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:24.677999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:24.678772 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.678234 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:37:24.678772 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.678257 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:37:24.678772 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.678274 2565 projected.go:196] Error preparing data for projected volume kube-api-access-gcwgk for pod openshift-network-diagnostics/network-check-target-76wtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:24.678772 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.678342 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk podName:cb37284c-086a-4da4-ac53-95b2244e4c86 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:28.678322809 +0000 UTC m=+10.198102200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcwgk" (UniqueName: "kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk") pod "network-check-target-76wtw" (UID: "cb37284c-086a-4da4-ac53-95b2244e4c86") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:24.897529 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:24.896962 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:24.897529 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.897090 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:24.897529 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:24.897256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:24.897529 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.897389 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:24.897529 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:24.897436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:24.897529 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:24.897521 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:26.896809 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:26.896775 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:26.897279 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:26.896912 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:26.897370 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:26.897342 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:26.897485 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:26.897462 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:26.897555 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:26.897535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:26.897631 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:26.897612 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:28.512882 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:28.512838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:28.513330 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:28.512903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:28.513330 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.513044 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:28.513330 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.513084 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:28.513330 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.513135 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret podName:96a58d9e-0266-4871-94ef-fc8deee52ebb nodeName:}" failed. No retries permitted until 2026-07-01 18:37:36.513111312 +0000 UTC m=+18.032890694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret") pod "global-pull-secret-syncer-wj9cb" (UID: "96a58d9e-0266-4871-94ef-fc8deee52ebb") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:28.513330 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.513159 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:36.513146999 +0000 UTC m=+18.032926378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:28.714548 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:28.714503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:28.715013 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.714769 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:37:28.715013 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.714795 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:37:28.715013 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.714810 2565 projected.go:196] Error preparing data for projected volume kube-api-access-gcwgk for pod openshift-network-diagnostics/network-check-target-76wtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:28.715013 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.714880 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk podName:cb37284c-086a-4da4-ac53-95b2244e4c86 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:36.714859438 +0000 UTC m=+18.234638823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcwgk" (UniqueName: "kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk") pod "network-check-target-76wtw" (UID: "cb37284c-086a-4da4-ac53-95b2244e4c86") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:28.897473 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:28.897388 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:28.897473 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:28.897429 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:28.898038 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:28.897388 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:28.898038 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.897628 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:28.898038 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.897745 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:28.898038 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:28.897829 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:30.897978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:30.897117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:30.897978 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:30.897266 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:30.897978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:30.897708 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:30.897978 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:30.897818 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:30.897978 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:30.897900 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:30.897978 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:30.897972 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:32.897743 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:32.897557 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:32.898107 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:32.897557 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:32.898107 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:32.897815 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:32.898107 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:32.897935 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:32.898107 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:32.897557 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:32.898107 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:32.898020 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:34.896806 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:34.896770 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:34.897229 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:34.896773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:34.897229 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:34.896923 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:34.897229 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:34.896773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:34.897229 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:34.896992 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:34.897229 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:34.897074 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:36.579757 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:36.579721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:36.580295 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:36.579770 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:36.580295 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.579879 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:36.580295 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.579943 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret podName:96a58d9e-0266-4871-94ef-fc8deee52ebb nodeName:}" failed. No retries permitted until 2026-07-01 18:37:52.579929606 +0000 UTC m=+34.099708985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret") pod "global-pull-secret-syncer-wj9cb" (UID: "96a58d9e-0266-4871-94ef-fc8deee52ebb") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:36.580295 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.579879 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:36.580295 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.580006 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:52.579995171 +0000 UTC m=+34.099774552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:36.781972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:36.781931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:36.782165 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.782129 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:37:36.782165 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.782153 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:37:36.782165 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.782167 2565 projected.go:196] Error preparing data for projected volume kube-api-access-gcwgk for pod openshift-network-diagnostics/network-check-target-76wtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:36.782317 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.782236 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk podName:cb37284c-086a-4da4-ac53-95b2244e4c86 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:52.782216013 +0000 UTC m=+34.301995410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcwgk" (UniqueName: "kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk") pod "network-check-target-76wtw" (UID: "cb37284c-086a-4da4-ac53-95b2244e4c86") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:36.897435 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:36.897397 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:36.897634 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:36.897446 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:36.897634 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:36.897397 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:36.897634 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.897532 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:36.897803 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.897645 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:36.897803 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:36.897708 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:38.897407 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:38.897370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:38.897881 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:38.897371 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:38.897881 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:38.897500 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:38.897881 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:38.897370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:38.897881 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:38.897570 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:38.897881 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:38.897664 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:40.896861 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:40.896789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:40.896861 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:40.896835 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:40.897343 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:40.896922 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:40.897343 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:40.896980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:40.897343 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:40.897112 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:40.897343 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:40.897232 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:41.899931 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:41.899899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:41.900481 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:41.900005 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:42.897732 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:42.897603 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:42.897939 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:42.897767 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:42.897939 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:42.897779 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:42.897939 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:42.897873 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:43.142137 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.142100 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"053356d42473af209a93a4a33c8bf66823b2f65f5cbb00f5c6f63f2871c15601"} Jul 01 18:37:43.144608 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.144366 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ns9mg" event={"ID":"327014f6-05be-4fbe-befe-2161d2ae573e","Type":"ContainerStarted","Data":"d1f64e0f24f30feff50c6f882e0e708d023b05fb715e13cab073f0519a96666d"} Jul 01 18:37:43.146361 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.146340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" event={"ID":"0dbb3df3-34c3-4c88-a4e5-d08b689d5e8d","Type":"ContainerStarted","Data":"b5904f3ca78206bdce62b098d633b101fa45dd1eb0d7156ee41b84ef3a1312ba"} Jul 01 18:37:43.147959 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.147899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" event={"ID":"e0e20c26ce09867b5f1755fe9406cdab","Type":"ContainerStarted","Data":"591b674b3c4c0d9a6cb1404ed9791a181b8e04b318c29d34cfdb07463555018e"} Jul 01 18:37:43.167670 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.167606 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ns9mg" podStartSLOduration=0.791608328 podStartE2EDuration="22.167590221s" totalImagesPullingTime="21.375981893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:43.167489351 +0000 UTC m=+24.687268749" watchObservedRunningTime="2026-07-01 18:37:43.167590221 +0000 UTC m=+24.687369620" Jul 01 18:37:43.184811 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.184761 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-230.ec2.internal" podStartSLOduration=22.184743656 podStartE2EDuration="22.184743656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:43.184597479 +0000 UTC m=+24.704376888" watchObservedRunningTime="2026-07-01 18:37:43.184743656 +0000 UTC m=+24.704523055" Jul 01 18:37:43.217295 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.217244 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z6n6w" podStartSLOduration=1.19055342 podStartE2EDuration="22.217230025s" totalImagesPullingTime="21.026676605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:43.217087577 +0000 UTC m=+24.736866983" watchObservedRunningTime="2026-07-01 18:37:43.217230025 +0000 UTC m=+24.737009422" Jul 01 18:37:43.899824 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:43.899654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:43.899973 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:43.899892 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:44.151423 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.151375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vdl8m" event={"ID":"f47f7abb-9c3d-4310-bfba-ef66564fd631","Type":"ContainerStarted","Data":"b135804502550764a45de81a508b07b3da70804a1d296d43deec8eb598fa0a24"} Jul 01 18:37:44.153016 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.152988 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bx8tq" event={"ID":"549b51a2-5ce7-4dec-b80b-ed88f88c3b1a","Type":"ContainerStarted","Data":"8a8b8b109791e5893756162332d7decfb3c5b6a91185deb387e3c7731f150c5f"} Jul 01 18:37:44.158461 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.158431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" event={"ID":"0492b07f-99f0-4848-9cf5-c80d9435cf50","Type":"ContainerStarted","Data":"143b87d6e5654f2cd8b8a95af7bf628781d3afee08d31262b9471b320fd2c9c5"} Jul 01 18:37:44.161469 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.161450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:37:44.161836 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.161815 2565 generic.go:356] "Generic (PLEG): container finished" podID="b18a49f5-162c-44a8-8a1f-21cc8b59d966" containerID="96d4795138c94aab64321c3d12145b83fefbe58a73eb56ffca37301096532b6a" exitCode=1 Jul 01 18:37:44.161930 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.161882 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"5e7a6ebe61af1844004ece0b312995eabb62181ac425edc18fa08381a19196ce"} Jul 01 18:37:44.161991 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.161935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"a0516f7ea8ada46a862342b9dea6f58582b9adc0506c706080be1ad007ef97dd"} Jul 01 18:37:44.161991 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.161970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"02a1c015b93ab00ca785cfb05abc8f6c514b6dc5f4b50b5a79f7c74319e90f28"} Jul 01 18:37:44.162079 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.162014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"3d88f3e816f216888fa7a2a119e852ccb01999ea1d8b969e55f2eee868d57c13"} Jul 01 18:37:44.162079 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.162043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerDied","Data":"96d4795138c94aab64321c3d12145b83fefbe58a73eb56ffca37301096532b6a"} Jul 01 18:37:44.163420 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.163395 2565 generic.go:356] "Generic (PLEG): container finished" podID="37844ed1-4709-4e55-95b1-1e29630de969" containerID="b7e2accacf2ab0bec2f30a2362d9bc14075e2e9c4db1892ed5ae0bb8d560bf1c" exitCode=0 Jul 01 18:37:44.163525 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.163472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerDied","Data":"b7e2accacf2ab0bec2f30a2362d9bc14075e2e9c4db1892ed5ae0bb8d560bf1c"} Jul 01 18:37:44.165018 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.164992 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg77g" event={"ID":"e6161fdd-3d07-425a-b61d-617ba4ece3d9","Type":"ContainerStarted","Data":"d97e155d1b8c504a2fecb40661a2ca7e0bf5460277d9e2dc4f18b9344b20222e"} Jul 01 18:37:44.166591 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.166570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qj9d4" event={"ID":"72755299-e3a5-41ee-9a19-2d0272fd44e0","Type":"ContainerStarted","Data":"b78bf92902d989bc093cee3fb65493750023e9a85f93b771d507d1d9da68398d"} Jul 01 18:37:44.168403 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.168378 2565 generic.go:356] "Generic (PLEG): container finished" podID="116575f1223264f944dddc62291c77f3" containerID="a8a65725eda2c28d4a2b50a1557021e66969ac349fa6d80ddc687068f338c144" exitCode=0 Jul 01 18:37:44.168497 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.168445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" event={"ID":"116575f1223264f944dddc62291c77f3","Type":"ContainerDied","Data":"a8a65725eda2c28d4a2b50a1557021e66969ac349fa6d80ddc687068f338c144"} Jul 01 18:37:44.172722 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.172684 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vdl8m" podStartSLOduration=2.158784609 podStartE2EDuration="23.172671054s" totalImagesPullingTime="21.013886445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:44.171825918 +0000 UTC m=+25.691605319" watchObservedRunningTime="2026-07-01 18:37:44.172671054 +0000 UTC m=+25.692450451" Jul 01 18:37:44.191908 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.191849 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qj9d4" podStartSLOduration=3.107317579 podStartE2EDuration="24.191810613s" totalImagesPullingTime="21.084493034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:44.191777952 +0000 UTC m=+25.711557349" watchObservedRunningTime="2026-07-01 18:37:44.191810613 +0000 UTC m=+25.711590011" Jul 01 18:37:44.212349 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.212295 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rg77g" podStartSLOduration=3.096370299 podStartE2EDuration="24.212274315s" totalImagesPullingTime="21.115904016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:44.21189788 +0000 UTC m=+25.731677278" watchObservedRunningTime="2026-07-01 18:37:44.212274315 +0000 UTC m=+25.732053714" Jul 01 18:37:44.242517 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.242468 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bx8tq" podStartSLOduration=2.201394765 podStartE2EDuration="23.242450165s" totalImagesPullingTime="21.0410554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:44.242000831 +0000 UTC m=+25.761780228" watchObservedRunningTime="2026-07-01 18:37:44.242450165 +0000 UTC m=+25.762229564" Jul 01 18:37:44.897453 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.897418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:44.897641 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.897468 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:44.897641 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:44.897556 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:44.897732 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:44.897716 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:44.950341 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:44.950303 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 18:37:45.172713 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:45.172676 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" event={"ID":"0492b07f-99f0-4848-9cf5-c80d9435cf50","Type":"ContainerStarted","Data":"16d56736a34ae5dd910534c040fbf51c047c43159e963e869bc024729b71d137"} Jul 01 18:37:45.900073 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:45.900048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:45.900233 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:45.900176 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:45.906479 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:45.906377 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T18:37:44.950322736Z","UUID":"1dddb886-7fa4-4b2c-a50a-72dc86176f1e","Handler":null,"Name":"","Endpoint":""} Jul 01 18:37:45.908189 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:45.908160 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 18:37:45.908322 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:45.908206 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 18:37:46.179424 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:46.179399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:37:46.179903 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:46.179879 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"30a76845a49c44085c22657526a27fcad27a193eed1530c9b3449d28750a6738"} Jul 01 18:37:46.181927 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:46.181896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" event={"ID":"116575f1223264f944dddc62291c77f3","Type":"ContainerStarted","Data":"d9f613bcd29d0cb2c0d6339f28686b3a63b2b0a3592188efc16e1bd2d081acd5"} Jul 01 18:37:46.204964 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:46.204899 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-230.ec2.internal" podStartSLOduration=25.204877492 podStartE2EDuration="25.204877492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:46.204363289 +0000 UTC m=+27.724142680" watchObservedRunningTime="2026-07-01 18:37:46.204877492 +0000 UTC m=+27.724656891" Jul 01 18:37:46.897307 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:46.897266 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:46.897460 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:46.897266 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:46.897460 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:46.897406 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:46.897581 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:46.897471 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:47.187473 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:47.187432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" event={"ID":"0492b07f-99f0-4848-9cf5-c80d9435cf50","Type":"ContainerStarted","Data":"e6bca3e1125c867a2f3e2edfa634eb98f68fcff9d7bed2b57ea7e71190a7c342"} Jul 01 18:37:47.229289 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:47.229240 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl2g8" podStartSLOduration=2.826244159 podStartE2EDuration="26.229223637s" totalImagesPullingTime="23.402979478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:47.228922424 +0000 UTC m=+28.748701821" watchObservedRunningTime="2026-07-01 18:37:47.229223637 +0000 UTC m=+28.749003034" Jul 01 18:37:47.897818 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:47.897569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:47.897980 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:47.897932 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:48.896821 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:48.896794 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:48.897513 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:48.896794 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:48.897513 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:48.896896 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:48.897513 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:48.896996 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:49.019579 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.019548 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:49.020301 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.020283 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:49.193599 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.193563 2565 generic.go:356] "Generic (PLEG): container finished" podID="37844ed1-4709-4e55-95b1-1e29630de969" containerID="a2622b7dab290ced0ff92e5dce9fc436d4e7eac0042369298116c830c7e415d6" exitCode=0 Jul 01 18:37:49.193790 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.193631 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerDied","Data":"a2622b7dab290ced0ff92e5dce9fc436d4e7eac0042369298116c830c7e415d6"} Jul 01 18:37:49.197140 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.197123 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:37:49.197491 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.197465 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"cc9fb8150964aa3173e0b23cf5e53609283651b267db8555487d3710410798e2"} Jul 01 18:37:49.197796 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.197773 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:49.197902 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.197811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:49.197902 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.197853 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:49.197996 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.197932 2565 scope.go:117] "RemoveContainer" containerID="96d4795138c94aab64321c3d12145b83fefbe58a73eb56ffca37301096532b6a" Jul 01 18:37:49.198261 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.198242 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qj9d4" Jul 01 18:37:49.214200 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.214161 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:49.898070 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:49.897853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:49.898662 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:49.898170 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:50.203048 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:50.202943 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:37:50.203278 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:50.203251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" event={"ID":"b18a49f5-162c-44a8-8a1f-21cc8b59d966","Type":"ContainerStarted","Data":"a06623ee4702d26028510e2508944f4b58c2174ef13227e854db4dd307fde0df"} Jul 01 18:37:50.203668 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:50.203641 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:50.219237 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:50.219212 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:37:50.240712 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:50.240665 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" podStartSLOduration=7.464132837 podStartE2EDuration="29.24065012s" totalImagesPullingTime="21.776517283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:50.240233647 +0000 UTC m=+31.760013035" watchObservedRunningTime="2026-07-01 18:37:50.24065012 +0000 UTC m=+31.760429517" Jul 01 18:37:50.897448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:50.897421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:50.897695 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:50.897425 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:50.897695 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:50.897519 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:50.897695 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:50.897610 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:51.207943 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.207855 2565 generic.go:356] "Generic (PLEG): container finished" podID="37844ed1-4709-4e55-95b1-1e29630de969" containerID="7e40a421ccd2bc726e509759dbe9f56eee517acc68935fa5cd95d04e63f18b5a" exitCode=0 Jul 01 18:37:51.208289 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.207946 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerDied","Data":"7e40a421ccd2bc726e509759dbe9f56eee517acc68935fa5cd95d04e63f18b5a"} Jul 01 18:37:51.285473 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.285417 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5l67"] Jul 01 18:37:51.285662 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.285609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:51.285743 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:51.285723 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:51.292962 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.292933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76wtw"] Jul 01 18:37:51.293136 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.293056 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:51.293214 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:51.293183 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:51.293572 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.293554 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wj9cb"] Jul 01 18:37:51.293666 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:51.293656 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:51.293739 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:51.293722 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:52.597302 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:52.597269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:52.597661 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:52.597348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:52.597661 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.597431 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:52.597661 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.597494 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:24.597479103 +0000 UTC m=+66.117258478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:37:52.597661 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.597441 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:52.597661 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.597559 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret podName:96a58d9e-0266-4871-94ef-fc8deee52ebb nodeName:}" failed. No retries permitted until 2026-07-01 18:38:24.59754889 +0000 UTC m=+66.117328265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret") pod "global-pull-secret-syncer-wj9cb" (UID: "96a58d9e-0266-4871-94ef-fc8deee52ebb") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:37:52.799265 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:52.799232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:52.799451 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.799427 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:37:52.799496 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.799461 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:37:52.799496 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.799475 2565 projected.go:196] Error preparing data for projected volume kube-api-access-gcwgk for pod openshift-network-diagnostics/network-check-target-76wtw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:52.799562 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.799542 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk podName:cb37284c-086a-4da4-ac53-95b2244e4c86 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:24.799523063 +0000 UTC m=+66.319302442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcwgk" (UniqueName: "kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk") pod "network-check-target-76wtw" (UID: "cb37284c-086a-4da4-ac53-95b2244e4c86") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:37:52.896840 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:52.896801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:52.897031 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:52.896801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:52.897031 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.896926 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:52.897031 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:52.896801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:52.897031 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.897012 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:52.897189 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:52.897074 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:53.215252 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:53.215218 2565 generic.go:356] "Generic (PLEG): container finished" podID="37844ed1-4709-4e55-95b1-1e29630de969" containerID="50c677c5249bf4140b7ff4eae4a0c78a3be19f9a86cb22911f67d8cb5f74a532" exitCode=0 Jul 01 18:37:53.215419 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:53.215263 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerDied","Data":"50c677c5249bf4140b7ff4eae4a0c78a3be19f9a86cb22911f67d8cb5f74a532"} Jul 01 18:37:54.897399 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:54.897361 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:54.897872 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:54.897482 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:54.897872 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:54.897499 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76wtw" podUID="cb37284c-086a-4da4-ac53-95b2244e4c86" Jul 01 18:37:54.897872 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:54.897524 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:54.897872 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:54.897648 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g5l67" podUID="b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6" Jul 01 18:37:54.897872 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:54.897748 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wj9cb" podUID="96a58d9e-0266-4871-94ef-fc8deee52ebb" Jul 01 18:37:56.670951 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.670768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:56.684894 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.684866 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-230.ec2.internal" event="NodeReady" Jul 01 18:37:56.685067 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.685033 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 18:37:56.769883 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.769850 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tj6qn"] Jul 01 18:37:56.774543 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.774452 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:56.775539 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.775512 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7ttl8"] Jul 01 18:37:56.777555 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.777533 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 18:37:56.777707 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.777556 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-555k5\"" Jul 01 18:37:56.778050 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.778035 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 18:37:56.778805 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.778788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:56.782207 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.782186 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 18:37:56.782323 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.782206 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sh8b7\"" Jul 01 18:37:56.782323 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.782306 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 18:37:56.782675 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.782650 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 18:37:56.793475 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.793452 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tj6qn"] Jul 01 18:37:56.796024 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.795999 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7ttl8"] Jul 01 18:37:56.804012 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.803973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:56.897239 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.897197 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:37:56.897239 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.897224 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:37:56.897498 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.897252 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:37:56.900577 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.900547 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:37:56.900900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.900752 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:37:56.900900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.900801 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qh8tt\"" Jul 01 18:37:56.900900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.900818 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:37:56.900900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.900823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:37:56.900900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.900851 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t4jbq\"" Jul 01 18:37:56.908569 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.908538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:56.931273 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.931193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7657be34-01f0-4ad4-a0de-35d55b71065b-tmp-dir\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:56.931273 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.931247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98d937a2-4285-4a0e-b084-d6d983dcd60b-cert\") pod \"ingress-canary-7ttl8\" (UID: \"98d937a2-4285-4a0e-b084-d6d983dcd60b\") " pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:56.931448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.931275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:56.931448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.931321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4txlt\" (UniqueName: \"kubernetes.io/projected/7657be34-01f0-4ad4-a0de-35d55b71065b-kube-api-access-4txlt\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:56.931448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.931362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7657be34-01f0-4ad4-a0de-35d55b71065b-config-volume\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:56.931448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.931398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzlhh\" (UniqueName: \"kubernetes.io/projected/98d937a2-4285-4a0e-b084-d6d983dcd60b-kube-api-access-xzlhh\") pod \"ingress-canary-7ttl8\" (UID: \"98d937a2-4285-4a0e-b084-d6d983dcd60b\") " pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:56.979590 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:56.979540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:57.032766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.032733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7657be34-01f0-4ad4-a0de-35d55b71065b-tmp-dir\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.032975 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.032798 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98d937a2-4285-4a0e-b084-d6d983dcd60b-cert\") pod \"ingress-canary-7ttl8\" (UID: \"98d937a2-4285-4a0e-b084-d6d983dcd60b\") " pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:57.032975 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.032828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.032975 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.032847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4txlt\" (UniqueName: \"kubernetes.io/projected/7657be34-01f0-4ad4-a0de-35d55b71065b-kube-api-access-4txlt\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.032975 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.032885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7657be34-01f0-4ad4-a0de-35d55b71065b-config-volume\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.032975 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.032928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzlhh\" (UniqueName: \"kubernetes.io/projected/98d937a2-4285-4a0e-b084-d6d983dcd60b-kube-api-access-xzlhh\") pod \"ingress-canary-7ttl8\" (UID: \"98d937a2-4285-4a0e-b084-d6d983dcd60b\") " pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:57.033213 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:57.033012 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:37:57.033213 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:57.033100 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls podName:7657be34-01f0-4ad4-a0de-35d55b71065b nodeName:}" failed. No retries permitted until 2026-07-01 18:37:57.533080114 +0000 UTC m=+39.052859508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls") pod "dns-default-tj6qn" (UID: "7657be34-01f0-4ad4-a0de-35d55b71065b") : secret "dns-default-metrics-tls" not found Jul 01 18:37:57.033317 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.033210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7657be34-01f0-4ad4-a0de-35d55b71065b-tmp-dir\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.033732 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.033711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7657be34-01f0-4ad4-a0de-35d55b71065b-config-volume\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.037727 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.037698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98d937a2-4285-4a0e-b084-d6d983dcd60b-cert\") pod \"ingress-canary-7ttl8\" (UID: \"98d937a2-4285-4a0e-b084-d6d983dcd60b\") " pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:57.047174 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.047145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4txlt\" (UniqueName: \"kubernetes.io/projected/7657be34-01f0-4ad4-a0de-35d55b71065b-kube-api-access-4txlt\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.047453 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.047428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzlhh\" (UniqueName: \"kubernetes.io/projected/98d937a2-4285-4a0e-b084-d6d983dcd60b-kube-api-access-xzlhh\") pod \"ingress-canary-7ttl8\" (UID: \"98d937a2-4285-4a0e-b084-d6d983dcd60b\") " pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:57.092378 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.092342 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7ttl8" Jul 01 18:37:57.375375 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.375240 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7ttl8"] Jul 01 18:37:57.378531 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:37:57.378497 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d937a2_4285_4a0e_b084_d6d983dcd60b.slice/crio-dffe7ea7ca30568bc34ce4188745b8eba1c9e085bfc82d7e576950247e2289ee WatchSource:0}: Error finding container dffe7ea7ca30568bc34ce4188745b8eba1c9e085bfc82d7e576950247e2289ee: Status 404 returned error can't find the container with id dffe7ea7ca30568bc34ce4188745b8eba1c9e085bfc82d7e576950247e2289ee Jul 01 18:37:57.538404 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:57.538362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:57.538592 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:57.538502 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:37:57.538592 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:57.538575 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls podName:7657be34-01f0-4ad4-a0de-35d55b71065b nodeName:}" failed. No retries permitted until 2026-07-01 18:37:58.538556806 +0000 UTC m=+40.058336181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls") pod "dns-default-tj6qn" (UID: "7657be34-01f0-4ad4-a0de-35d55b71065b") : secret "dns-default-metrics-tls" not found Jul 01 18:37:58.232662 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:58.232604 2565 generic.go:356] "Generic (PLEG): container finished" podID="37844ed1-4709-4e55-95b1-1e29630de969" containerID="a94bbbe124874d4640a8780679f36e4d00c2f97b187ed0c718faa57a3dfcc30b" exitCode=0 Jul 01 18:37:58.232662 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:58.232648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerDied","Data":"a94bbbe124874d4640a8780679f36e4d00c2f97b187ed0c718faa57a3dfcc30b"} Jul 01 18:37:58.234053 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:58.234015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7ttl8" event={"ID":"98d937a2-4285-4a0e-b084-d6d983dcd60b","Type":"ContainerStarted","Data":"dffe7ea7ca30568bc34ce4188745b8eba1c9e085bfc82d7e576950247e2289ee"} Jul 01 18:37:58.548011 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:58.547931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:37:58.548172 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:58.548056 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:37:58.548172 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:37:58.548127 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls podName:7657be34-01f0-4ad4-a0de-35d55b71065b nodeName:}" failed. No retries permitted until 2026-07-01 18:38:00.548105001 +0000 UTC m=+42.067884400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls") pod "dns-default-tj6qn" (UID: "7657be34-01f0-4ad4-a0de-35d55b71065b") : secret "dns-default-metrics-tls" not found Jul 01 18:37:59.240727 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:59.240692 2565 generic.go:356] "Generic (PLEG): container finished" podID="37844ed1-4709-4e55-95b1-1e29630de969" containerID="74d08b548dde2054036700bcee9552d62c41e11ac31b4322447555f64c86e6b2" exitCode=0 Jul 01 18:37:59.241197 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:59.240745 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerDied","Data":"74d08b548dde2054036700bcee9552d62c41e11ac31b4322447555f64c86e6b2"} Jul 01 18:37:59.987732 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:37:59.987703 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:00.093276 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.093238 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:00.246463 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.246433 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" event={"ID":"37844ed1-4709-4e55-95b1-1e29630de969","Type":"ContainerStarted","Data":"0a1cced71d9b7547caf977cb9dd5c0279a8ed166a99b929d1504243298f7dc82"} Jul 01 18:38:00.247793 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.247772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7ttl8" event={"ID":"98d937a2-4285-4a0e-b084-d6d983dcd60b","Type":"ContainerStarted","Data":"8292f4fcdf6b517a06dca20dca569aeecf30a347e3234e45a412ad8fda132bc6"} Jul 01 18:38:00.279755 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.279705 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qb5z2" podStartSLOduration=7.272159122 podStartE2EDuration="39.279690656s" totalImagesPullingTime="32.007531534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:00.277951455 +0000 UTC m=+41.797730853" watchObservedRunningTime="2026-07-01 18:38:00.279690656 +0000 UTC m=+41.799470054" Jul 01 18:38:00.309714 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.309662 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7ttl8" podStartSLOduration=1.796110578 podStartE2EDuration="4.309644774s" totalImagesPullingTime="2.513534196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:00.309224595 +0000 UTC m=+41.829003991" watchObservedRunningTime="2026-07-01 18:38:00.309644774 +0000 UTC m=+41.829424172" Jul 01 18:38:00.521361 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.521278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:00.564377 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.564337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:00.564505 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:00.564462 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:38:00.564543 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:00.564512 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls podName:7657be34-01f0-4ad4-a0de-35d55b71065b nodeName:}" failed. No retries permitted until 2026-07-01 18:38:04.564500166 +0000 UTC m=+46.084279545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls") pod "dns-default-tj6qn" (UID: "7657be34-01f0-4ad4-a0de-35d55b71065b") : secret "dns-default-metrics-tls" not found Jul 01 18:38:00.620108 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.620078 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:00.771059 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.771024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:00.847032 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.846945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:00.929033 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.928997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:00.990814 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:00.990782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:02.881564 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.881531 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-d4jxj"] Jul 01 18:38:02.912209 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.912182 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:02.915779 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.915750 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 18:38:02.916091 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.915749 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-d4jxj"] Jul 01 18:38:02.916321 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.916298 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rc6mh\"" Jul 01 18:38:02.916428 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.916327 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 18:38:02.917539 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.917515 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 18:38:02.917679 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.917658 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 18:38:02.922185 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:02.922164 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 18:38:03.006115 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.006083 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c4786ff87-gsp8r"] Jul 01 18:38:03.027314 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.027288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.032601 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.032578 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 18:38:03.034027 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.034006 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 18:38:03.034248 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.034228 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-97dnk\"" Jul 01 18:38:03.034512 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.034494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 18:38:03.034604 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.034553 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 18:38:03.034945 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.034930 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 18:38:03.035041 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.034934 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 18:38:03.035422 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.035394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c4786ff87-gsp8r"] Jul 01 18:38:03.083325 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.083296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77fda808-a14a-4626-81b9-d0b4b1291e33-service-ca-bundle\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.083325 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.083327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77fda808-a14a-4626-81b9-d0b4b1291e33-serving-cert\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.083577 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.083346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/77fda808-a14a-4626-81b9-d0b4b1291e33-snapshots\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.083577 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.083371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77fda808-a14a-4626-81b9-d0b4b1291e33-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.083577 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.083401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77fda808-a14a-4626-81b9-d0b4b1291e33-tmp\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.083577 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.083477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffxfh\" (UniqueName: \"kubernetes.io/projected/77fda808-a14a-4626-81b9-d0b4b1291e33-kube-api-access-ffxfh\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.184311 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77fda808-a14a-4626-81b9-d0b4b1291e33-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.184487 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77fda808-a14a-4626-81b9-d0b4b1291e33-tmp\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.184487 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffxfh\" (UniqueName: \"kubernetes.io/projected/77fda808-a14a-4626-81b9-d0b4b1291e33-kube-api-access-ffxfh\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.184639 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-default-certificate\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.184698 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-stats-auth\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.184698 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.184776 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjgtv\" (UniqueName: \"kubernetes.io/projected/216417e3-c6f2-42d7-9883-963212ccc155-kube-api-access-vjgtv\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.184776 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77fda808-a14a-4626-81b9-d0b4b1291e33-service-ca-bundle\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.184855 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77fda808-a14a-4626-81b9-d0b4b1291e33-serving-cert\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.184855 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.184855 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184828 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77fda808-a14a-4626-81b9-d0b4b1291e33-tmp\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.184855 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.184836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/77fda808-a14a-4626-81b9-d0b4b1291e33-snapshots\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.185262 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.185240 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/77fda808-a14a-4626-81b9-d0b4b1291e33-snapshots\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.185305 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.185284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77fda808-a14a-4626-81b9-d0b4b1291e33-service-ca-bundle\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.185356 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.185339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77fda808-a14a-4626-81b9-d0b4b1291e33-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.188588 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.188561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77fda808-a14a-4626-81b9-d0b4b1291e33-serving-cert\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.194465 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.194441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffxfh\" (UniqueName: \"kubernetes.io/projected/77fda808-a14a-4626-81b9-d0b4b1291e33-kube-api-access-ffxfh\") pod \"insights-operator-5f67b55555-d4jxj\" (UID: \"77fda808-a14a-4626-81b9-d0b4b1291e33\") " pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.225268 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.225233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-d4jxj" Jul 01 18:38:03.259206 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.259175 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:03.286118 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.286082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-default-certificate\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.286118 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.286116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-stats-auth\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.286391 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.286141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.286391 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.286163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjgtv\" (UniqueName: \"kubernetes.io/projected/216417e3-c6f2-42d7-9883-963212ccc155-kube-api-access-vjgtv\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.286391 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.286197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.286391 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:03.286243 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:38:03.286391 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:03.286337 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:03.786319217 +0000 UTC m=+45.306098615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : configmap references non-existent config key: service-ca.crt Jul 01 18:38:03.286391 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:03.286360 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:03.78634942 +0000 UTC m=+45.306128812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : secret "router-metrics-certs-default" not found Jul 01 18:38:03.288741 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.288710 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-default-certificate\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.288842 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.288763 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-stats-auth\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.298693 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.298593 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjgtv\" (UniqueName: \"kubernetes.io/projected/216417e3-c6f2-42d7-9883-963212ccc155-kube-api-access-vjgtv\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.364731 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.364702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:03.391916 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.391885 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-d4jxj"] Jul 01 18:38:03.394754 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:03.394725 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77fda808_a14a_4626_81b9_d0b4b1291e33.slice/crio-26beb7112cfecb50788ba67ed1902385493ef63149db66da4903c7cb57b7ae72 WatchSource:0}: Error finding container 26beb7112cfecb50788ba67ed1902385493ef63149db66da4903c7cb57b7ae72: Status 404 returned error can't find the container with id 26beb7112cfecb50788ba67ed1902385493ef63149db66da4903c7cb57b7ae72 Jul 01 18:38:03.790373 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.790334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.790545 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:03.790387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:03.790545 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:03.790491 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:38:03.790545 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:03.790505 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:04.790490187 +0000 UTC m=+46.310269564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : configmap references non-existent config key: service-ca.crt Jul 01 18:38:03.790545 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:03.790545 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:04.790530256 +0000 UTC m=+46.310309657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : secret "router-metrics-certs-default" not found Jul 01 18:38:04.261094 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:04.261025 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-d4jxj" event={"ID":"77fda808-a14a-4626-81b9-d0b4b1291e33","Type":"ContainerStarted","Data":"26beb7112cfecb50788ba67ed1902385493ef63149db66da4903c7cb57b7ae72"} Jul 01 18:38:04.595574 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:04.595482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:04.595756 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:04.595652 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:38:04.595756 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:04.595741 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls podName:7657be34-01f0-4ad4-a0de-35d55b71065b nodeName:}" failed. No retries permitted until 2026-07-01 18:38:12.595719519 +0000 UTC m=+54.115498912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls") pod "dns-default-tj6qn" (UID: "7657be34-01f0-4ad4-a0de-35d55b71065b") : secret "dns-default-metrics-tls" not found Jul 01 18:38:04.796398 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:04.796357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:04.796564 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:04.796433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:04.796564 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:04.796534 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:38:04.796679 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:04.796601 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:06.796581385 +0000 UTC m=+48.316360777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : configmap references non-existent config key: service-ca.crt Jul 01 18:38:04.796679 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:04.796646 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:06.796633824 +0000 UTC m=+48.316413205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : secret "router-metrics-certs-default" not found Jul 01 18:38:05.051841 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:05.051800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:06.268857 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:06.268808 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-d4jxj" event={"ID":"77fda808-a14a-4626-81b9-d0b4b1291e33","Type":"ContainerStarted","Data":"e74db3c963e6b745e0eb2f1514f855d64dd45d451d08f69fbf9c0e2b2a2c257e"} Jul 01 18:38:06.293574 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:06.293480 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-d4jxj" podStartSLOduration=1.6585966829999998 podStartE2EDuration="4.293463241s" totalImagesPullingTime="2.634866558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:06.293091595 +0000 UTC m=+47.812870992" watchObservedRunningTime="2026-07-01 18:38:06.293463241 +0000 UTC m=+47.813242638" Jul 01 18:38:06.812331 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:06.812289 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:06.812331 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:06.812338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:06.812541 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:06.812481 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:38:06.812541 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:06.812527 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:10.812511167 +0000 UTC m=+52.332290564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : configmap references non-existent config key: service-ca.crt Jul 01 18:38:06.812654 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:06.812556 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:10.812537202 +0000 UTC m=+52.332316588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : secret "router-metrics-certs-default" not found Jul 01 18:38:07.086880 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.086807 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ms5fr"] Jul 01 18:38:07.120823 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.120790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ms5fr"] Jul 01 18:38:07.120970 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.120904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.124784 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.124762 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 18:38:07.124905 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.124781 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zc75h\"" Jul 01 18:38:07.124905 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.124770 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 18:38:07.215883 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.215849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.216072 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.215918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ef190ed-55c1-4153-8118-f8452ee70532-crio-socket\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.216072 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.215947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.216170 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.216097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef190ed-55c1-4153-8118-f8452ee70532-data-volume\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.216170 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.216128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzhkf\" (UniqueName: \"kubernetes.io/projected/8ef190ed-55c1-4153-8118-f8452ee70532-kube-api-access-mzhkf\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.316936 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.316899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ef190ed-55c1-4153-8118-f8452ee70532-crio-socket\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.316936 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.316932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.317001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ef190ed-55c1-4153-8118-f8452ee70532-crio-socket\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.317012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef190ed-55c1-4153-8118-f8452ee70532-data-volume\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.317038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzhkf\" (UniqueName: \"kubernetes.io/projected/8ef190ed-55c1-4153-8118-f8452ee70532-kube-api-access-mzhkf\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.317059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.317061 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.317120 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:07.81710323 +0000 UTC m=+49.336882606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : configmap "kube-rbac-proxy" not found Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.317180 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.317233 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:07.817217659 +0000 UTC m=+49.336997035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : secret "insights-runtime-extractor-tls" not found Jul 01 18:38:07.317384 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.317297 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef190ed-55c1-4153-8118-f8452ee70532-data-volume\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.336511 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.336485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzhkf\" (UniqueName: \"kubernetes.io/projected/8ef190ed-55c1-4153-8118-f8452ee70532-kube-api-access-mzhkf\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.821096 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.821046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.821291 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:07.821166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:07.821291 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.821185 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:38:07.821291 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.821247 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:08.821230962 +0000 UTC m=+50.341010336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : configmap "kube-rbac-proxy" not found Jul 01 18:38:07.821291 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.821268 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:38:07.821425 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:07.821312 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:08.821300659 +0000 UTC m=+50.341080035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : secret "insights-runtime-extractor-tls" not found Jul 01 18:38:08.829055 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:08.829010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:08.829511 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:08.829070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:08.829511 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:08.829176 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:38:08.829511 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:08.829232 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:38:08.829511 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:08.829247 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:10.829229054 +0000 UTC m=+52.349008433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : secret "insights-runtime-extractor-tls" not found Jul 01 18:38:08.829511 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:08.829293 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:10.829276967 +0000 UTC m=+52.349056591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : configmap "kube-rbac-proxy" not found Jul 01 18:38:08.875962 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:08.875934 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vdl8m_f47f7abb-9c3d-4310-bfba-ef66564fd631/dns-node-resolver/0.log" Jul 01 18:38:09.271767 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:09.271739 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bx8tq_549b51a2-5ce7-4dec-b80b-ed88f88c3b1a/node-ca/0.log" Jul 01 18:38:10.272218 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:10.272192 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7ttl8_98d937a2-4285-4a0e-b084-d6d983dcd60b/serve-healthcheck-canary/0.log" Jul 01 18:38:10.847183 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:10.847145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:10.847369 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:10.847199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:10.847369 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:10.847232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:10.847369 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:10.847282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:10.847369 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:10.847315 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:38:10.847497 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:10.847381 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:18.847362336 +0000 UTC m=+60.367141730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : secret "router-metrics-certs-default" not found Jul 01 18:38:10.847497 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:10.847383 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:38:10.847497 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:10.847381 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:38:10.847497 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:10.847416 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:18.847400006 +0000 UTC m=+60.367179380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : configmap references non-existent config key: service-ca.crt Jul 01 18:38:10.847497 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:10.847440 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:14.847432545 +0000 UTC m=+56.367211919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : configmap "kube-rbac-proxy" not found Jul 01 18:38:10.847497 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:10.847456 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:14.84744689 +0000 UTC m=+56.367226265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : secret "insights-runtime-extractor-tls" not found Jul 01 18:38:12.661727 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.661689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:12.662180 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:12.661825 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:38:12.662180 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:12.661905 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls podName:7657be34-01f0-4ad4-a0de-35d55b71065b nodeName:}" failed. No retries permitted until 2026-07-01 18:38:28.661888944 +0000 UTC m=+70.181668319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls") pod "dns-default-tj6qn" (UID: "7657be34-01f0-4ad4-a0de-35d55b71065b") : secret "dns-default-metrics-tls" not found Jul 01 18:38:12.863269 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.863215 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp"] Jul 01 18:38:12.883737 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.883703 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp"] Jul 01 18:38:12.883879 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.883825 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:12.886981 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.886960 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:38:12.887112 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.886991 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 18:38:12.887291 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.887274 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 18:38:12.888536 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.888520 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 18:38:12.889135 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.888948 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h58bg\"" Jul 01 18:38:12.964061 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.963975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-config\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:12.964061 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.964021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:12.964252 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.964080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2h4x\" (UniqueName: \"kubernetes.io/projected/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-kube-api-access-g2h4x\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:12.966992 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.966961 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw"] Jul 01 18:38:12.988905 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.988875 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd"] Jul 01 18:38:12.989086 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.989010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" Jul 01 18:38:12.992235 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.992207 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:38:12.992383 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.992238 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lb4rx\"" Jul 01 18:38:12.992383 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:12.992238 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 18:38:13.009634 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.009595 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-cwsj6"] Jul 01 18:38:13.009804 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.009719 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.012944 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.012920 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 18:38:13.013197 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.012973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 18:38:13.013197 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.012978 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 18:38:13.013197 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.013071 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j5dzx\"" Jul 01 18:38:13.013197 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.013089 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:38:13.031720 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.031692 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd"] Jul 01 18:38:13.031720 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.031730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw"] Jul 01 18:38:13.031900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.031745 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-cwsj6"] Jul 01 18:38:13.031900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.031818 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.035311 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.035278 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 18:38:13.035311 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.035278 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nb49p\"" Jul 01 18:38:13.035640 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.035285 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:38:13.035640 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.035578 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 18:38:13.035640 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.035603 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 18:38:13.039990 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.039973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 18:38:13.065094 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:13.065094 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/143a2d25-e82e-4e19-b068-c86262369ffc-serving-cert\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.065308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8pmd\" (UniqueName: \"kubernetes.io/projected/ed517e24-7427-481e-98b6-d43b4847f4a4-kube-api-access-p8pmd\") pod \"volume-data-source-validator-69d9f679db-sgwtw\" (UID: \"ed517e24-7427-481e-98b6-d43b4847f4a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" Jul 01 18:38:13.065308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/143a2d25-e82e-4e19-b068-c86262369ffc-trusted-ca\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.065308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zb9\" (UniqueName: \"kubernetes.io/projected/143a2d25-e82e-4e19-b068-c86262369ffc-kube-api-access-j5zb9\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.065308 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-config\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:13.065448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2h4x\" (UniqueName: \"kubernetes.io/projected/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-kube-api-access-g2h4x\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:13.065448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45a7b0d9-b228-4edc-a12c-784601bf03f2-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.065448 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45a7b0d9-b228-4edc-a12c-784601bf03f2-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.065588 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrgv7\" (UniqueName: \"kubernetes.io/projected/45a7b0d9-b228-4edc-a12c-784601bf03f2-kube-api-access-lrgv7\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.065657 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/143a2d25-e82e-4e19-b068-c86262369ffc-config\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.065867 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.065840 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-config\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:13.067459 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.067441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:13.076690 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.076659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2h4x\" (UniqueName: \"kubernetes.io/projected/28bfb98e-1d2d-486e-b79e-1e1740cd3c60-kube-api-access-g2h4x\") pod \"service-ca-operator-5d7b7dc95c-xvtrp\" (UID: \"28bfb98e-1d2d-486e-b79e-1e1740cd3c60\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:13.166381 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pmd\" (UniqueName: \"kubernetes.io/projected/ed517e24-7427-481e-98b6-d43b4847f4a4-kube-api-access-p8pmd\") pod \"volume-data-source-validator-69d9f679db-sgwtw\" (UID: \"ed517e24-7427-481e-98b6-d43b4847f4a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" Jul 01 18:38:13.166381 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/143a2d25-e82e-4e19-b068-c86262369ffc-trusted-ca\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.166678 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zb9\" (UniqueName: \"kubernetes.io/projected/143a2d25-e82e-4e19-b068-c86262369ffc-kube-api-access-j5zb9\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.166678 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45a7b0d9-b228-4edc-a12c-784601bf03f2-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.166678 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45a7b0d9-b228-4edc-a12c-784601bf03f2-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.166678 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrgv7\" (UniqueName: \"kubernetes.io/projected/45a7b0d9-b228-4edc-a12c-784601bf03f2-kube-api-access-lrgv7\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.166678 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/143a2d25-e82e-4e19-b068-c86262369ffc-config\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.166958 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.166790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/143a2d25-e82e-4e19-b068-c86262369ffc-serving-cert\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.167234 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.167195 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45a7b0d9-b228-4edc-a12c-784601bf03f2-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.167390 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.167261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/143a2d25-e82e-4e19-b068-c86262369ffc-config\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.167390 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.167284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/143a2d25-e82e-4e19-b068-c86262369ffc-trusted-ca\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.168811 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.168791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45a7b0d9-b228-4edc-a12c-784601bf03f2-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.168969 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.168952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/143a2d25-e82e-4e19-b068-c86262369ffc-serving-cert\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.176526 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.176492 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrgv7\" (UniqueName: \"kubernetes.io/projected/45a7b0d9-b228-4edc-a12c-784601bf03f2-kube-api-access-lrgv7\") pod \"kube-storage-version-migrator-operator-79964ff6f9-vw6xd\" (UID: \"45a7b0d9-b228-4edc-a12c-784601bf03f2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.176671 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.176605 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8pmd\" (UniqueName: \"kubernetes.io/projected/ed517e24-7427-481e-98b6-d43b4847f4a4-kube-api-access-p8pmd\") pod \"volume-data-source-validator-69d9f679db-sgwtw\" (UID: \"ed517e24-7427-481e-98b6-d43b4847f4a4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" Jul 01 18:38:13.176983 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.176966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zb9\" (UniqueName: \"kubernetes.io/projected/143a2d25-e82e-4e19-b068-c86262369ffc-kube-api-access-j5zb9\") pod \"console-operator-7fdbdf9c99-cwsj6\" (UID: \"143a2d25-e82e-4e19-b068-c86262369ffc\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.193992 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.193737 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" Jul 01 18:38:13.298714 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.298687 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" Jul 01 18:38:13.318972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.318947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" Jul 01 18:38:13.340412 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.340381 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:13.363004 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.362864 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp"] Jul 01 18:38:13.369513 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:13.369466 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bfb98e_1d2d_486e_b79e_1e1740cd3c60.slice/crio-740a4783258e77ea22f2c38d35c06b95e8c48ea3809521baf47d9417eeee91a5 WatchSource:0}: Error finding container 740a4783258e77ea22f2c38d35c06b95e8c48ea3809521baf47d9417eeee91a5: Status 404 returned error can't find the container with id 740a4783258e77ea22f2c38d35c06b95e8c48ea3809521baf47d9417eeee91a5 Jul 01 18:38:13.473094 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.473024 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw"] Jul 01 18:38:13.476382 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:13.476344 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded517e24_7427_481e_98b6_d43b4847f4a4.slice/crio-8cd81bdcbc3ccb4a3913c76ebf5f9c129fed106f4df3886a2bb9d2b29e06566a WatchSource:0}: Error finding container 8cd81bdcbc3ccb4a3913c76ebf5f9c129fed106f4df3886a2bb9d2b29e06566a: Status 404 returned error can't find the container with id 8cd81bdcbc3ccb4a3913c76ebf5f9c129fed106f4df3886a2bb9d2b29e06566a Jul 01 18:38:13.487850 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.487799 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd"] Jul 01 18:38:13.490351 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:13.490271 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a7b0d9_b228_4edc_a12c_784601bf03f2.slice/crio-cceff0e539f46d2b5cd2746843d3c7666022096f728bfaa4bd887441d6956275 WatchSource:0}: Error finding container cceff0e539f46d2b5cd2746843d3c7666022096f728bfaa4bd887441d6956275: Status 404 returned error can't find the container with id cceff0e539f46d2b5cd2746843d3c7666022096f728bfaa4bd887441d6956275 Jul 01 18:38:13.513769 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:13.513731 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-cwsj6"] Jul 01 18:38:13.517968 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:13.517941 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143a2d25_e82e_4e19_b068_c86262369ffc.slice/crio-d14a6301333015254d55f6aabd3847c2512b62a7bcdd4d88c294829e6878ff2e WatchSource:0}: Error finding container d14a6301333015254d55f6aabd3847c2512b62a7bcdd4d88c294829e6878ff2e: Status 404 returned error can't find the container with id d14a6301333015254d55f6aabd3847c2512b62a7bcdd4d88c294829e6878ff2e Jul 01 18:38:14.291488 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:14.291438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" event={"ID":"ed517e24-7427-481e-98b6-d43b4847f4a4","Type":"ContainerStarted","Data":"8cd81bdcbc3ccb4a3913c76ebf5f9c129fed106f4df3886a2bb9d2b29e06566a"} Jul 01 18:38:14.294092 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:14.294012 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" event={"ID":"28bfb98e-1d2d-486e-b79e-1e1740cd3c60","Type":"ContainerStarted","Data":"740a4783258e77ea22f2c38d35c06b95e8c48ea3809521baf47d9417eeee91a5"} Jul 01 18:38:14.295551 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:14.295453 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" event={"ID":"143a2d25-e82e-4e19-b068-c86262369ffc","Type":"ContainerStarted","Data":"d14a6301333015254d55f6aabd3847c2512b62a7bcdd4d88c294829e6878ff2e"} Jul 01 18:38:14.297258 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:14.297159 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" event={"ID":"45a7b0d9-b228-4edc-a12c-784601bf03f2","Type":"ContainerStarted","Data":"cceff0e539f46d2b5cd2746843d3c7666022096f728bfaa4bd887441d6956275"} Jul 01 18:38:14.884551 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:14.884501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:14.884766 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:14.884576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:14.884766 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:14.884738 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:38:14.884881 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:14.884804 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:22.884784273 +0000 UTC m=+64.404563662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : secret "insights-runtime-extractor-tls" not found Jul 01 18:38:14.885584 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:14.885546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ef190ed-55c1-4153-8118-f8452ee70532-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:17.308097 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.308051 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" event={"ID":"ed517e24-7427-481e-98b6-d43b4847f4a4","Type":"ContainerStarted","Data":"aae13549688386274501e11c806c89f210e7eca7f6fc39e4ed5a6747ed756d6e"} Jul 01 18:38:17.309705 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.309676 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" event={"ID":"28bfb98e-1d2d-486e-b79e-1e1740cd3c60","Type":"ContainerStarted","Data":"9b78054d7f259d2edf234741a61a9f9d51150a2567895312d9853bcf69ff13ae"} Jul 01 18:38:17.311397 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.311373 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/0.log" Jul 01 18:38:17.311530 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.311417 2565 generic.go:356] "Generic (PLEG): container finished" podID="143a2d25-e82e-4e19-b068-c86262369ffc" containerID="9095db8d6c5992aa60d276c23e8c6ccef967d6d348ee092229dd524103399da5" exitCode=255 Jul 01 18:38:17.311530 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.311498 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" event={"ID":"143a2d25-e82e-4e19-b068-c86262369ffc","Type":"ContainerDied","Data":"9095db8d6c5992aa60d276c23e8c6ccef967d6d348ee092229dd524103399da5"} Jul 01 18:38:17.311718 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.311702 2565 scope.go:117] "RemoveContainer" containerID="9095db8d6c5992aa60d276c23e8c6ccef967d6d348ee092229dd524103399da5" Jul 01 18:38:17.313251 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.313231 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" event={"ID":"45a7b0d9-b228-4edc-a12c-784601bf03f2","Type":"ContainerStarted","Data":"857f7f518a40a730bd51ecb91fd968bb10ec8defba1f0641c6c8777b1209a070"} Jul 01 18:38:17.337791 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.337743 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-sgwtw" podStartSLOduration=2.140446921 podStartE2EDuration="5.33772827s" totalImagesPullingTime="3.197281349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:17.337504519 +0000 UTC m=+58.857283917" watchObservedRunningTime="2026-07-01 18:38:17.33772827 +0000 UTC m=+58.857507667" Jul 01 18:38:17.357180 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.357126 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" podStartSLOduration=2.155190044 podStartE2EDuration="5.357109686s" totalImagesPullingTime="3.201919642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:17.355984759 +0000 UTC m=+58.875764157" watchObservedRunningTime="2026-07-01 18:38:17.357109686 +0000 UTC m=+58.876889083" Jul 01 18:38:17.401160 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:17.401103 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" podStartSLOduration=2.094322167 podStartE2EDuration="5.401087377s" totalImagesPullingTime="3.30676521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:17.375949922 +0000 UTC m=+58.895729323" watchObservedRunningTime="2026-07-01 18:38:17.401087377 +0000 UTC m=+58.920866769" Jul 01 18:38:18.318517 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.318489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:38:18.318960 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.318916 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/0.log" Jul 01 18:38:18.318960 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.318947 2565 generic.go:356] "Generic (PLEG): container finished" podID="143a2d25-e82e-4e19-b068-c86262369ffc" containerID="543e65ae4d155a05eef75354a5cc6ef3756ab95aec1721a32919644ec9702245" exitCode=255 Jul 01 18:38:18.319054 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.318980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" event={"ID":"143a2d25-e82e-4e19-b068-c86262369ffc","Type":"ContainerDied","Data":"543e65ae4d155a05eef75354a5cc6ef3756ab95aec1721a32919644ec9702245"} Jul 01 18:38:18.319054 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.319041 2565 scope.go:117] "RemoveContainer" containerID="9095db8d6c5992aa60d276c23e8c6ccef967d6d348ee092229dd524103399da5" Jul 01 18:38:18.319439 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.319416 2565 scope.go:117] "RemoveContainer" containerID="543e65ae4d155a05eef75354a5cc6ef3756ab95aec1721a32919644ec9702245" Jul 01 18:38:18.319591 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:18.319571 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-cwsj6_openshift-console-operator(143a2d25-e82e-4e19-b068-c86262369ffc)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" podUID="143a2d25-e82e-4e19-b068-c86262369ffc" Jul 01 18:38:18.920226 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.920192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:18.920410 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:18.920271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:18.920410 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:18.920351 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 18:38:18.920410 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:18.920404 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:34.920389405 +0000 UTC m=+76.440168791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : configmap references non-existent config key: service-ca.crt Jul 01 18:38:18.920528 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:18.920422 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs podName:216417e3-c6f2-42d7-9883-963212ccc155 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:34.920414867 +0000 UTC m=+76.440194241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs") pod "router-default-6c4786ff87-gsp8r" (UID: "216417e3-c6f2-42d7-9883-963212ccc155") : secret "router-metrics-certs-default" not found Jul 01 18:38:19.323967 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:19.323894 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:38:19.324314 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:19.324216 2565 scope.go:117] "RemoveContainer" containerID="543e65ae4d155a05eef75354a5cc6ef3756ab95aec1721a32919644ec9702245" Jul 01 18:38:19.324399 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:19.324376 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-cwsj6_openshift-console-operator(143a2d25-e82e-4e19-b068-c86262369ffc)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" podUID="143a2d25-e82e-4e19-b068-c86262369ffc" Jul 01 18:38:22.224380 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:22.224349 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxdj5" Jul 01 18:38:22.959210 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:22.959163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:22.959422 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:22.959300 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:38:22.959422 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:22.959376 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls podName:8ef190ed-55c1-4153-8118-f8452ee70532 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:38.959356554 +0000 UTC m=+80.479135928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ms5fr" (UID: "8ef190ed-55c1-4153-8118-f8452ee70532") : secret "insights-runtime-extractor-tls" not found Jul 01 18:38:23.341344 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:23.341257 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:23.341344 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:23.341304 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:23.341773 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:23.341656 2565 scope.go:117] "RemoveContainer" containerID="543e65ae4d155a05eef75354a5cc6ef3756ab95aec1721a32919644ec9702245" Jul 01 18:38:23.341817 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:23.341803 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-cwsj6_openshift-console-operator(143a2d25-e82e-4e19-b068-c86262369ffc)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" podUID="143a2d25-e82e-4e19-b068-c86262369ffc" Jul 01 18:38:24.672446 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.672392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:38:24.672446 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.672457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:38:24.675845 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.675825 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:38:24.675921 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.675883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:38:24.682754 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:24.682727 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 18:38:24.682825 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:24.682806 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs podName:b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:39:28.682783593 +0000 UTC m=+130.202562976 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs") pod "network-metrics-daemon-g5l67" (UID: "b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6") : secret "metrics-daemon-secret" not found Jul 01 18:38:24.684925 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.684905 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96a58d9e-0266-4871-94ef-fc8deee52ebb-original-pull-secret\") pod \"global-pull-secret-syncer-wj9cb\" (UID: \"96a58d9e-0266-4871-94ef-fc8deee52ebb\") " pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:38:24.815058 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.815017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wj9cb" Jul 01 18:38:24.874959 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.874916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:38:24.878936 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.878687 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:38:24.889173 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.889137 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:38:24.899703 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.899677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcwgk\" (UniqueName: \"kubernetes.io/projected/cb37284c-086a-4da4-ac53-95b2244e4c86-kube-api-access-gcwgk\") pod \"network-check-target-76wtw\" (UID: \"cb37284c-086a-4da4-ac53-95b2244e4c86\") " pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:38:24.949696 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:24.949611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wj9cb"] Jul 01 18:38:24.953267 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:24.953242 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a58d9e_0266_4871_94ef_fc8deee52ebb.slice/crio-5c5ea067a20ecce5ad3db8484c0bd531b40a7262bd4374c63758957376c432a3 WatchSource:0}: Error finding container 5c5ea067a20ecce5ad3db8484c0bd531b40a7262bd4374c63758957376c432a3: Status 404 returned error can't find the container with id 5c5ea067a20ecce5ad3db8484c0bd531b40a7262bd4374c63758957376c432a3 Jul 01 18:38:25.111321 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:25.111291 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qh8tt\"" Jul 01 18:38:25.118228 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:25.118208 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:38:25.248574 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:25.248490 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76wtw"] Jul 01 18:38:25.251224 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:25.251186 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb37284c_086a_4da4_ac53_95b2244e4c86.slice/crio-450c9cdd6517c7c095aa1790dd7c3b0b48d5660cb5db4adb212a3a213c759a9e WatchSource:0}: Error finding container 450c9cdd6517c7c095aa1790dd7c3b0b48d5660cb5db4adb212a3a213c759a9e: Status 404 returned error can't find the container with id 450c9cdd6517c7c095aa1790dd7c3b0b48d5660cb5db4adb212a3a213c759a9e Jul 01 18:38:25.342431 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:25.342395 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76wtw" event={"ID":"cb37284c-086a-4da4-ac53-95b2244e4c86","Type":"ContainerStarted","Data":"450c9cdd6517c7c095aa1790dd7c3b0b48d5660cb5db4adb212a3a213c759a9e"} Jul 01 18:38:25.343754 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:25.343720 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wj9cb" event={"ID":"96a58d9e-0266-4871-94ef-fc8deee52ebb","Type":"ContainerStarted","Data":"5c5ea067a20ecce5ad3db8484c0bd531b40a7262bd4374c63758957376c432a3"} Jul 01 18:38:28.708545 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:28.708505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:28.711182 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:28.711145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7657be34-01f0-4ad4-a0de-35d55b71065b-metrics-tls\") pod \"dns-default-tj6qn\" (UID: \"7657be34-01f0-4ad4-a0de-35d55b71065b\") " pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:28.891180 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:28.891149 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-555k5\"" Jul 01 18:38:28.897276 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:28.897247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:29.921017 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:29.920986 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tj6qn"] Jul 01 18:38:29.924374 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:29.924348 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7657be34_01f0_4ad4_a0de_35d55b71065b.slice/crio-83c3e9c29f6e9916d997e79328020a2e59270d2b8a9981a52a9cec87d5ff4092 WatchSource:0}: Error finding container 83c3e9c29f6e9916d997e79328020a2e59270d2b8a9981a52a9cec87d5ff4092: Status 404 returned error can't find the container with id 83c3e9c29f6e9916d997e79328020a2e59270d2b8a9981a52a9cec87d5ff4092 Jul 01 18:38:30.364121 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:30.364088 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wj9cb" event={"ID":"96a58d9e-0266-4871-94ef-fc8deee52ebb","Type":"ContainerStarted","Data":"8443c7df77fec923b02deec5bb17de44e4bd89d65fd4ba04e66a8603dbf2e7c5"} Jul 01 18:38:30.365590 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:30.365564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76wtw" event={"ID":"cb37284c-086a-4da4-ac53-95b2244e4c86","Type":"ContainerStarted","Data":"0b5ac419213f7453a7f34cc6d5f2d89564027f30195b93532a51e00b31b6c639"} Jul 01 18:38:30.365741 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:30.365634 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:38:30.366774 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:30.366754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj6qn" event={"ID":"7657be34-01f0-4ad4-a0de-35d55b71065b","Type":"ContainerStarted","Data":"83c3e9c29f6e9916d997e79328020a2e59270d2b8a9981a52a9cec87d5ff4092"} Jul 01 18:38:30.387128 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:30.387080 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wj9cb" podStartSLOduration=64.561321704 podStartE2EDuration="1m9.387065014s" totalImagesPullingTime="4.82574331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:30.386674258 +0000 UTC m=+71.906453656" watchObservedRunningTime="2026-07-01 18:38:30.387065014 +0000 UTC m=+71.906844410" Jul 01 18:38:30.411419 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:30.411356 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-76wtw" podStartSLOduration=64.898547111 podStartE2EDuration="1m9.411334767s" totalImagesPullingTime="4.512787656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:30.410224843 +0000 UTC m=+71.930004239" watchObservedRunningTime="2026-07-01 18:38:30.411334767 +0000 UTC m=+71.931114164" Jul 01 18:38:32.375679 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:32.375644 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj6qn" event={"ID":"7657be34-01f0-4ad4-a0de-35d55b71065b","Type":"ContainerStarted","Data":"62d677c539671b3eaba04cad9ca9454c324c13c35e69b68bb1f8e3354b5f38e5"} Jul 01 18:38:32.376142 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:32.375700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj6qn" event={"ID":"7657be34-01f0-4ad4-a0de-35d55b71065b","Type":"ContainerStarted","Data":"46346e1a7711a05c65b866203bb0e0fc3f00dc1fbd84e75088b3849c9d49ddfe"} Jul 01 18:38:32.376142 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:32.375736 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:32.410266 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:32.410214 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tj6qn" podStartSLOduration=34.535092373 podStartE2EDuration="36.410197253s" totalImagesPullingTime="1.87510488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:32.409526299 +0000 UTC m=+73.929305697" watchObservedRunningTime="2026-07-01 18:38:32.410197253 +0000 UTC m=+73.929976649" Jul 01 18:38:34.960179 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:34.960140 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:34.960584 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:34.960217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:34.960915 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:34.960895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/216417e3-c6f2-42d7-9883-963212ccc155-service-ca-bundle\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:34.962535 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:34.962517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/216417e3-c6f2-42d7-9883-963212ccc155-metrics-certs\") pod \"router-default-6c4786ff87-gsp8r\" (UID: \"216417e3-c6f2-42d7-9883-963212ccc155\") " pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:35.140094 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:35.140064 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-97dnk\"" Jul 01 18:38:35.147674 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:35.147648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:35.292422 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:35.292389 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c4786ff87-gsp8r"] Jul 01 18:38:35.295770 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:35.295745 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216417e3_c6f2_42d7_9883_963212ccc155.slice/crio-a3716adeb21d77d57c55eb95cd4fd201d8232cf954afca61b159022355a22f73 WatchSource:0}: Error finding container a3716adeb21d77d57c55eb95cd4fd201d8232cf954afca61b159022355a22f73: Status 404 returned error can't find the container with id a3716adeb21d77d57c55eb95cd4fd201d8232cf954afca61b159022355a22f73 Jul 01 18:38:35.388608 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:35.388579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" event={"ID":"216417e3-c6f2-42d7-9883-963212ccc155","Type":"ContainerStarted","Data":"39467b2fd7dc08dd2e99170c00da381858d087193326226d01fde5a0e5c3cfe7"} Jul 01 18:38:35.388795 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:35.388643 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" event={"ID":"216417e3-c6f2-42d7-9883-963212ccc155","Type":"ContainerStarted","Data":"a3716adeb21d77d57c55eb95cd4fd201d8232cf954afca61b159022355a22f73"} Jul 01 18:38:35.415825 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:35.415774 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" podStartSLOduration=33.415757139 podStartE2EDuration="33.415757139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:35.414928269 +0000 UTC m=+76.934707690" watchObservedRunningTime="2026-07-01 18:38:35.415757139 +0000 UTC m=+76.935536544" Jul 01 18:38:36.148184 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:36.148137 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:36.150934 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:36.150907 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:36.391746 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:36.391717 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:36.392976 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:36.392955 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c4786ff87-gsp8r" Jul 01 18:38:36.897268 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:36.897233 2565 scope.go:117] "RemoveContainer" containerID="543e65ae4d155a05eef75354a5cc6ef3756ab95aec1721a32919644ec9702245" Jul 01 18:38:37.397013 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:37.396993 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:38:37.397366 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:37.397111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" event={"ID":"143a2d25-e82e-4e19-b068-c86262369ffc","Type":"ContainerStarted","Data":"5a0f2e0783b363b570b1488cb474161fbc20202d3385bf0f079dce703257a7ed"} Jul 01 18:38:37.397530 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:37.397511 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:37.431755 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:37.431701 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" podStartSLOduration=22.268520503 podStartE2EDuration="25.431686885s" totalImagesPullingTime="3.163166382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:37.431188954 +0000 UTC m=+78.950968361" watchObservedRunningTime="2026-07-01 18:38:37.431686885 +0000 UTC m=+78.951466282" Jul 01 18:38:37.791469 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:37.791385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-cwsj6" Jul 01 18:38:38.994761 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:38.994725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:38.997101 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:38.997071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ef190ed-55c1-4153-8118-f8452ee70532-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms5fr\" (UID: \"8ef190ed-55c1-4153-8118-f8452ee70532\") " pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:39.233633 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:39.233588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zc75h\"" Jul 01 18:38:39.240679 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:39.240652 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ms5fr" Jul 01 18:38:39.392118 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:39.392086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ms5fr"] Jul 01 18:38:39.395303 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:39.395276 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef190ed_55c1_4153_8118_f8452ee70532.slice/crio-c67c1d8ae06e3e42fb4c3acdbde73217b0b676b71dd996a7155594f400e8f2bf WatchSource:0}: Error finding container c67c1d8ae06e3e42fb4c3acdbde73217b0b676b71dd996a7155594f400e8f2bf: Status 404 returned error can't find the container with id c67c1d8ae06e3e42fb4c3acdbde73217b0b676b71dd996a7155594f400e8f2bf Jul 01 18:38:39.406555 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:39.406521 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms5fr" event={"ID":"8ef190ed-55c1-4153-8118-f8452ee70532","Type":"ContainerStarted","Data":"c67c1d8ae06e3e42fb4c3acdbde73217b0b676b71dd996a7155594f400e8f2bf"} Jul 01 18:38:42.381093 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:42.380966 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tj6qn" Jul 01 18:38:43.422827 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.422749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms5fr" event={"ID":"8ef190ed-55c1-4153-8118-f8452ee70532","Type":"ContainerStarted","Data":"26fc0e2948f47c081500445bdf158cfb3dc3e1a8865e8c57ea27efcfb547c02c"} Jul 01 18:38:43.548419 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.548389 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv"] Jul 01 18:38:43.551656 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.551630 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.559045 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.559021 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 18:38:43.560641 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.560596 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cscbx\"" Jul 01 18:38:43.561332 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.561307 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 18:38:43.561444 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.561424 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 18:38:43.561497 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.561483 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 18:38:43.574890 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.574702 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv"] Jul 01 18:38:43.613467 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.613435 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-gstk4"] Jul 01 18:38:43.616687 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.616663 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" Jul 01 18:38:43.620521 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.620495 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f4l5h\"" Jul 01 18:38:43.635190 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.635156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b1f7f96-7d94-43ee-8f19-c13bf888cdc3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5847c4bd84-kjvlv\" (UID: \"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.635347 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.635227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdq6l\" (UniqueName: \"kubernetes.io/projected/3b1f7f96-7d94-43ee-8f19-c13bf888cdc3-kube-api-access-bdq6l\") pod \"managed-serviceaccount-addon-agent-5847c4bd84-kjvlv\" (UID: \"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.639975 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.639949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-gstk4"] Jul 01 18:38:43.721648 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.721557 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-gtt46"] Jul 01 18:38:43.725234 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.725213 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-gtt46" Jul 01 18:38:43.731917 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.731897 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 18:38:43.732550 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.732529 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 18:38:43.733339 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.733322 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gl62d\"" Jul 01 18:38:43.736339 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.736321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b1f7f96-7d94-43ee-8f19-c13bf888cdc3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5847c4bd84-kjvlv\" (UID: \"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.736437 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.736363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdq6l\" (UniqueName: \"kubernetes.io/projected/3b1f7f96-7d94-43ee-8f19-c13bf888cdc3-kube-api-access-bdq6l\") pod \"managed-serviceaccount-addon-agent-5847c4bd84-kjvlv\" (UID: \"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.736437 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.736389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzkj\" (UniqueName: \"kubernetes.io/projected/d55de872-2ac6-4c28-8f20-95df15fe6bc0-kube-api-access-gzzkj\") pod \"network-check-source-56499946bc-gstk4\" (UID: \"d55de872-2ac6-4c28-8f20-95df15fe6bc0\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" Jul 01 18:38:43.739201 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.739176 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b1f7f96-7d94-43ee-8f19-c13bf888cdc3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5847c4bd84-kjvlv\" (UID: \"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.739966 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.739948 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ddd8f8646-5rpkd"] Jul 01 18:38:43.742703 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.742686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.746900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.746883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 18:38:43.747232 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.747218 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 18:38:43.747462 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.747447 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 18:38:43.747542 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.747456 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qpglp\"" Jul 01 18:38:43.762430 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.762412 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 18:38:43.794228 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.794201 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-gtt46"] Jul 01 18:38:43.795109 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.795092 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd8f8646-5rpkd"] Jul 01 18:38:43.799721 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.799697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdq6l\" (UniqueName: \"kubernetes.io/projected/3b1f7f96-7d94-43ee-8f19-c13bf888cdc3-kube-api-access-bdq6l\") pod \"managed-serviceaccount-addon-agent-5847c4bd84-kjvlv\" (UID: \"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.837036 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4eec8612-8959-4895-9e75-dcf657748437-trusted-ca\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.837186 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m886s\" (UniqueName: \"kubernetes.io/projected/9a618b3e-b569-45d0-8b3d-c398d48a2ec3-kube-api-access-m886s\") pod \"downloads-5499b6fb8f-gtt46\" (UID: \"9a618b3e-b569-45d0-8b3d-c398d48a2ec3\") " pod="openshift-console/downloads-5499b6fb8f-gtt46" Jul 01 18:38:43.837186 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4eec8612-8959-4895-9e75-dcf657748437-installation-pull-secrets\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.837186 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-registry-tls\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.837186 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4eec8612-8959-4895-9e75-dcf657748437-registry-certificates\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.837186 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4eec8612-8959-4895-9e75-dcf657748437-image-registry-private-configuration\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.837474 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4eec8612-8959-4895-9e75-dcf657748437-ca-trust-extracted\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.837474 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzkj\" (UniqueName: \"kubernetes.io/projected/d55de872-2ac6-4c28-8f20-95df15fe6bc0-kube-api-access-gzzkj\") pod \"network-check-source-56499946bc-gstk4\" (UID: \"d55de872-2ac6-4c28-8f20-95df15fe6bc0\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" Jul 01 18:38:43.837474 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-bound-sa-token\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.837474 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.837350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5bhx\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-kube-api-access-x5bhx\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.855732 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.855709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzkj\" (UniqueName: \"kubernetes.io/projected/d55de872-2ac6-4c28-8f20-95df15fe6bc0-kube-api-access-gzzkj\") pod \"network-check-source-56499946bc-gstk4\" (UID: \"d55de872-2ac6-4c28-8f20-95df15fe6bc0\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" Jul 01 18:38:43.871862 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.871838 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" Jul 01 18:38:43.926596 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.926563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" Jul 01 18:38:43.938548 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.938499 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-bound-sa-token\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.938548 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.938545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5bhx\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-kube-api-access-x5bhx\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.938780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.938575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4eec8612-8959-4895-9e75-dcf657748437-trusted-ca\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.938780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.938606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m886s\" (UniqueName: \"kubernetes.io/projected/9a618b3e-b569-45d0-8b3d-c398d48a2ec3-kube-api-access-m886s\") pod \"downloads-5499b6fb8f-gtt46\" (UID: \"9a618b3e-b569-45d0-8b3d-c398d48a2ec3\") " pod="openshift-console/downloads-5499b6fb8f-gtt46" Jul 01 18:38:43.938780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.938667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4eec8612-8959-4895-9e75-dcf657748437-installation-pull-secrets\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.938780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.938692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-registry-tls\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.938977 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.938796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4eec8612-8959-4895-9e75-dcf657748437-registry-certificates\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.939665 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.939637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4eec8612-8959-4895-9e75-dcf657748437-image-registry-private-configuration\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.939785 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.939682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4eec8612-8959-4895-9e75-dcf657748437-ca-trust-extracted\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.940040 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.940012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4eec8612-8959-4895-9e75-dcf657748437-registry-certificates\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.940133 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.940042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4eec8612-8959-4895-9e75-dcf657748437-ca-trust-extracted\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.940323 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.940186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4eec8612-8959-4895-9e75-dcf657748437-trusted-ca\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.942103 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.942078 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4eec8612-8959-4895-9e75-dcf657748437-installation-pull-secrets\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.942195 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.942157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4eec8612-8959-4895-9e75-dcf657748437-image-registry-private-configuration\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.942682 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.942665 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-registry-tls\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.959773 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.959751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5bhx\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-kube-api-access-x5bhx\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:43.961937 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.961913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m886s\" (UniqueName: \"kubernetes.io/projected/9a618b3e-b569-45d0-8b3d-c398d48a2ec3-kube-api-access-m886s\") pod \"downloads-5499b6fb8f-gtt46\" (UID: \"9a618b3e-b569-45d0-8b3d-c398d48a2ec3\") " pod="openshift-console/downloads-5499b6fb8f-gtt46" Jul 01 18:38:43.962507 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:43.962474 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4eec8612-8959-4895-9e75-dcf657748437-bound-sa-token\") pod \"image-registry-6ddd8f8646-5rpkd\" (UID: \"4eec8612-8959-4895-9e75-dcf657748437\") " pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:44.033972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.033938 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-gtt46" Jul 01 18:38:44.047788 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.047644 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv"] Jul 01 18:38:44.049735 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:44.049708 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b1f7f96_7d94_43ee_8f19_c13bf888cdc3.slice/crio-e96d2fd0e27f6a8710dbe601439afb1486534a6a16edf49802b8ad805f778e90 WatchSource:0}: Error finding container e96d2fd0e27f6a8710dbe601439afb1486534a6a16edf49802b8ad805f778e90: Status 404 returned error can't find the container with id e96d2fd0e27f6a8710dbe601439afb1486534a6a16edf49802b8ad805f778e90 Jul 01 18:38:44.052823 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.052460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:44.113952 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.113924 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-gstk4"] Jul 01 18:38:44.118878 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:44.118827 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55de872_2ac6_4c28_8f20_95df15fe6bc0.slice/crio-6acfcd77e79d1c4482eb37ffa78f3ddbe4e6ee250eb205dabc0a2ab9dc60c7b8 WatchSource:0}: Error finding container 6acfcd77e79d1c4482eb37ffa78f3ddbe4e6ee250eb205dabc0a2ab9dc60c7b8: Status 404 returned error can't find the container with id 6acfcd77e79d1c4482eb37ffa78f3ddbe4e6ee250eb205dabc0a2ab9dc60c7b8 Jul 01 18:38:44.189390 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.189109 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-gtt46"] Jul 01 18:38:44.218170 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.218142 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd8f8646-5rpkd"] Jul 01 18:38:44.220853 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:38:44.220823 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eec8612_8959_4895_9e75_dcf657748437.slice/crio-f10b1cca3bebde5970d7db8d07408efb1e3c00aa97e8b33b1ab2d2815ab19742 WatchSource:0}: Error finding container f10b1cca3bebde5970d7db8d07408efb1e3c00aa97e8b33b1ab2d2815ab19742: Status 404 returned error can't find the container with id f10b1cca3bebde5970d7db8d07408efb1e3c00aa97e8b33b1ab2d2815ab19742 Jul 01 18:38:44.429189 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.429145 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms5fr" event={"ID":"8ef190ed-55c1-4153-8118-f8452ee70532","Type":"ContainerStarted","Data":"a9acc13e007ce330ef8ae0fa3853639e7c321c9129e0445378a1cc42e47d2b76"} Jul 01 18:38:44.431428 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.431398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" event={"ID":"4eec8612-8959-4895-9e75-dcf657748437","Type":"ContainerStarted","Data":"8885e97183d80072a1de919becc673b3c99dd109b3202fb1d700fc996a903e0e"} Jul 01 18:38:44.431595 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.431448 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" event={"ID":"4eec8612-8959-4895-9e75-dcf657748437","Type":"ContainerStarted","Data":"f10b1cca3bebde5970d7db8d07408efb1e3c00aa97e8b33b1ab2d2815ab19742"} Jul 01 18:38:44.431595 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.431475 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:38:44.433681 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.433557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" event={"ID":"d55de872-2ac6-4c28-8f20-95df15fe6bc0","Type":"ContainerStarted","Data":"af049843c4bfce921ff64bd19265ac2a507329537d47b96a04b1b328e43354eb"} Jul 01 18:38:44.433681 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.433634 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" event={"ID":"d55de872-2ac6-4c28-8f20-95df15fe6bc0","Type":"ContainerStarted","Data":"6acfcd77e79d1c4482eb37ffa78f3ddbe4e6ee250eb205dabc0a2ab9dc60c7b8"} Jul 01 18:38:44.435104 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.435054 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-gtt46" event={"ID":"9a618b3e-b569-45d0-8b3d-c398d48a2ec3","Type":"ContainerStarted","Data":"ab7807d08daf9f33a6b818e55277151efcd5430cb2b72a3f29cdf5bbb2b8f75e"} Jul 01 18:38:44.436746 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.436719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" event={"ID":"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3","Type":"ContainerStarted","Data":"e96d2fd0e27f6a8710dbe601439afb1486534a6a16edf49802b8ad805f778e90"} Jul 01 18:38:44.494053 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.493996 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" podStartSLOduration=1.493981548 podStartE2EDuration="1.493981548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:44.49381695 +0000 UTC m=+86.013596347" watchObservedRunningTime="2026-07-01 18:38:44.493981548 +0000 UTC m=+86.013760944" Jul 01 18:38:44.539492 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:44.539381 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-gstk4" podStartSLOduration=1.539358249 podStartE2EDuration="1.539358249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:44.537643982 +0000 UTC m=+86.057423371" watchObservedRunningTime="2026-07-01 18:38:44.539358249 +0000 UTC m=+86.059137626" Jul 01 18:38:47.452629 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:47.452569 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms5fr" event={"ID":"8ef190ed-55c1-4153-8118-f8452ee70532","Type":"ContainerStarted","Data":"3e9b50adf73d1e42606ce15304bc8d1b9792e834b2b19a9f00f7740c19e4b44b"} Jul 01 18:38:47.495334 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:47.495249 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ms5fr" podStartSLOduration=33.314943817 podStartE2EDuration="40.495228452s" totalImagesPullingTime="7.180284635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:38:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:47.493194474 +0000 UTC m=+89.012973873" watchObservedRunningTime="2026-07-01 18:38:47.495228452 +0000 UTC m=+89.015007850" Jul 01 18:38:50.464717 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:50.464680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" event={"ID":"3b1f7f96-7d94-43ee-8f19-c13bf888cdc3","Type":"ContainerStarted","Data":"7d5f829c1e7aced78f5621b9b8ea33211dd4ea0a375860c1d61d013fdf433e10"} Jul 01 18:38:55.681378 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.681313 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5847c4bd84-kjvlv" podStartSLOduration=7.311689511 podStartE2EDuration="12.681291707s" totalImagesPullingTime="5.369602196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:50.49277991 +0000 UTC m=+92.012559309" watchObservedRunningTime="2026-07-01 18:38:55.681291707 +0000 UTC m=+97.201071105" Jul 01 18:38:55.682638 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.682597 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kztmh"] Jul 01 18:38:55.687398 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.687379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.694255 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.694228 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 18:38:55.694382 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.694276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 18:38:55.695080 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.695054 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 18:38:55.695189 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.695112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gtflm\"" Jul 01 18:38:55.695189 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.695139 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 18:38:55.695944 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.695928 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 18:38:55.696020 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.695928 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 18:38:55.751929 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.751893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752118 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.751977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-tls\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752118 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.752023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-textfile\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752118 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.752052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k6dz\" (UniqueName: \"kubernetes.io/projected/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-kube-api-access-4k6dz\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752118 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.752078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-metrics-client-ca\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752281 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.752172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-sys\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752281 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.752235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-wtmp\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752281 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.752271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.752398 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.752310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-root\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853342 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-textfile\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853527 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k6dz\" (UniqueName: \"kubernetes.io/projected/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-kube-api-access-4k6dz\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853527 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-metrics-client-ca\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853527 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-sys\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853527 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-sys\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853738 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-wtmp\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853738 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853574 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853738 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-root\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853738 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.853738 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-tls\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.854024 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853739 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-wtmp\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.854024 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-root\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.854024 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:55.853806 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 18:38:55.854024 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.853815 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-textfile\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.854024 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:38:55.853860 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-tls podName:3311ccbb-6659-4082-ba78-b2ebb24dc3f4 nodeName:}" failed. No retries permitted until 2026-07-01 18:38:56.353847022 +0000 UTC m=+97.873626397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-tls") pod "node-exporter-kztmh" (UID: "3311ccbb-6659-4082-ba78-b2ebb24dc3f4") : secret "node-exporter-tls" not found Jul 01 18:38:55.854282 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.854048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-metrics-client-ca\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.854282 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.854184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.856372 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.856346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:55.867750 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:55.867686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k6dz\" (UniqueName: \"kubernetes.io/projected/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-kube-api-access-4k6dz\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:56.356666 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:56.356609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-tls\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:56.359287 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:56.359261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3311ccbb-6659-4082-ba78-b2ebb24dc3f4-node-exporter-tls\") pod \"node-exporter-kztmh\" (UID: \"3311ccbb-6659-4082-ba78-b2ebb24dc3f4\") " pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:56.598744 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:56.598706 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kztmh" Jul 01 18:38:58.623452 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.623412 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59774b7cd7-7bzpv"] Jul 01 18:38:58.630715 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.630685 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.634650 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.634073 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 18:38:58.634650 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.634200 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 18:38:58.634650 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.634366 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 18:38:58.634650 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.634480 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 18:38:58.634650 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.634629 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 18:38:58.635782 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.635759 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-de1u8muo24hg8\"" Jul 01 18:38:58.635912 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.635822 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7dj95\"" Jul 01 18:38:58.646355 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.646327 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59774b7cd7-7bzpv"] Jul 01 18:38:58.674878 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.674847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.675079 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.674884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.675079 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.674927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6133aeb-3abf-40a7-8958-3864004f6fb3-metrics-client-ca\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.675195 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.675088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46m4\" (UniqueName: \"kubernetes.io/projected/c6133aeb-3abf-40a7-8958-3864004f6fb3-kube-api-access-j46m4\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.675195 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.675127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.675271 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.675195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-grpc-tls\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.675271 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.675250 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-tls\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.675351 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.675282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776181 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46m4\" (UniqueName: \"kubernetes.io/projected/c6133aeb-3abf-40a7-8958-3864004f6fb3-kube-api-access-j46m4\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776455 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776455 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-grpc-tls\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776455 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-tls\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776455 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776455 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776455 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.776970 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.776464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6133aeb-3abf-40a7-8958-3864004f6fb3-metrics-client-ca\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.777736 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.777711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6133aeb-3abf-40a7-8958-3864004f6fb3-metrics-client-ca\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.779706 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.779657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.779706 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.779657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.779872 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.779853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.780026 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.780003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-tls\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.780077 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.780060 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-grpc-tls\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.780551 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.780527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c6133aeb-3abf-40a7-8958-3864004f6fb3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.790805 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.790761 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46m4\" (UniqueName: \"kubernetes.io/projected/c6133aeb-3abf-40a7-8958-3864004f6fb3-kube-api-access-j46m4\") pod \"thanos-querier-59774b7cd7-7bzpv\" (UID: \"c6133aeb-3abf-40a7-8958-3864004f6fb3\") " pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:38:58.944101 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:38:58.944067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:39:00.987061 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:39:00.987033 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3311ccbb_6659_4082_ba78_b2ebb24dc3f4.slice/crio-1658859fe543ae4a2e31ba8f59aaf1aaf45e97dab1c72d5c2703d4fc582b4aed WatchSource:0}: Error finding container 1658859fe543ae4a2e31ba8f59aaf1aaf45e97dab1c72d5c2703d4fc582b4aed: Status 404 returned error can't find the container with id 1658859fe543ae4a2e31ba8f59aaf1aaf45e97dab1c72d5c2703d4fc582b4aed Jul 01 18:39:01.130593 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.130557 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59774b7cd7-7bzpv"] Jul 01 18:39:01.132439 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:39:01.132413 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6133aeb_3abf_40a7_8958_3864004f6fb3.slice/crio-1b465cbc6e7fb3f0e59637ddbfd7518af4b697032428a6b1bb4c2ed04f8ee360 WatchSource:0}: Error finding container 1b465cbc6e7fb3f0e59637ddbfd7518af4b697032428a6b1bb4c2ed04f8ee360: Status 404 returned error can't find the container with id 1b465cbc6e7fb3f0e59637ddbfd7518af4b697032428a6b1bb4c2ed04f8ee360 Jul 01 18:39:01.374071 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.373980 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-76wtw" Jul 01 18:39:01.506386 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.506351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kztmh" event={"ID":"3311ccbb-6659-4082-ba78-b2ebb24dc3f4","Type":"ContainerStarted","Data":"1658859fe543ae4a2e31ba8f59aaf1aaf45e97dab1c72d5c2703d4fc582b4aed"} Jul 01 18:39:01.508295 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.508266 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-gtt46" event={"ID":"9a618b3e-b569-45d0-8b3d-c398d48a2ec3","Type":"ContainerStarted","Data":"88d0c3a9622e941216fc29b3381dd34531c00de340b26af5536f3879ba47f344"} Jul 01 18:39:01.508689 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.508639 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-gtt46" Jul 01 18:39:01.509923 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.509875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" event={"ID":"c6133aeb-3abf-40a7-8958-3864004f6fb3","Type":"ContainerStarted","Data":"1b465cbc6e7fb3f0e59637ddbfd7518af4b697032428a6b1bb4c2ed04f8ee360"} Jul 01 18:39:01.510066 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.510035 2565 patch_prober.go:28] interesting pod/downloads-5499b6fb8f-gtt46 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.17:8080/\": dial tcp 10.132.0.17:8080: connect: connection refused" start-of-body= Jul 01 18:39:01.510186 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:01.510092 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5499b6fb8f-gtt46" podUID="9a618b3e-b569-45d0-8b3d-c398d48a2ec3" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.17:8080/\": dial tcp 10.132.0.17:8080: connect: connection refused" Jul 01 18:39:02.517447 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:02.517407 2565 generic.go:356] "Generic (PLEG): container finished" podID="3311ccbb-6659-4082-ba78-b2ebb24dc3f4" containerID="90b5a5c19a52f146f7c20aaf391cffcd95691ad4ca3e3f9bf0dc2b610549841f" exitCode=0 Jul 01 18:39:02.519096 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:02.519060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kztmh" event={"ID":"3311ccbb-6659-4082-ba78-b2ebb24dc3f4","Type":"ContainerDied","Data":"90b5a5c19a52f146f7c20aaf391cffcd95691ad4ca3e3f9bf0dc2b610549841f"} Jul 01 18:39:02.535850 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:02.535819 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-gtt46" Jul 01 18:39:02.548028 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:02.547956 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-gtt46" podStartSLOduration=2.410896202 podStartE2EDuration="19.547932707s" totalImagesPullingTime="17.137036505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:01.535460036 +0000 UTC m=+103.055239434" watchObservedRunningTime="2026-07-01 18:39:02.547932707 +0000 UTC m=+104.067712109" Jul 01 18:39:03.527006 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:03.526965 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kztmh" event={"ID":"3311ccbb-6659-4082-ba78-b2ebb24dc3f4","Type":"ContainerStarted","Data":"bcf8323e9b4740b1c93d8a68d786835dc64374b7a5121188d6b0e9659c22d2e4"} Jul 01 18:39:03.527484 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:03.527045 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kztmh" event={"ID":"3311ccbb-6659-4082-ba78-b2ebb24dc3f4","Type":"ContainerStarted","Data":"5c512c5bd9ad4a73900ec359e54de2b36580d2667b133f855ff7576f3032e46e"} Jul 01 18:39:05.446704 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:05.446665 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6ddd8f8646-5rpkd" Jul 01 18:39:05.479026 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:05.478967 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kztmh" podStartSLOduration=9.359675505 podStartE2EDuration="10.478947847s" totalImagesPullingTime="1.035723665s" totalInitContainerRuntime="83.548677ms" isStatefulPod=true podCreationTimestamp="2026-07-01 18:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:03.553812895 +0000 UTC m=+105.073592292" watchObservedRunningTime="2026-07-01 18:39:05.478947847 +0000 UTC m=+106.998727245" Jul 01 18:39:05.538517 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:05.538479 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" event={"ID":"c6133aeb-3abf-40a7-8958-3864004f6fb3","Type":"ContainerStarted","Data":"b08fb5106852e816899d0319e9e186c8aa76b62a9e61fea33feecbacc6afc36a"} Jul 01 18:39:05.538734 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:05.538567 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" event={"ID":"c6133aeb-3abf-40a7-8958-3864004f6fb3","Type":"ContainerStarted","Data":"6b714609caf582a35f27a733fd9f07454e5501e1200f29435ba39380d188a507"} Jul 01 18:39:05.538734 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:05.538632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" event={"ID":"c6133aeb-3abf-40a7-8958-3864004f6fb3","Type":"ContainerStarted","Data":"3e28540d44da08655f19b401c52304fa05cc294749b2bdc3cf371c9cd21c8147"} Jul 01 18:39:06.545830 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:06.545789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" event={"ID":"c6133aeb-3abf-40a7-8958-3864004f6fb3","Type":"ContainerStarted","Data":"0fc3abf6a0f0a3361b65d53487a7478a847e9dd5b9b72c0250af79211d4545da"} Jul 01 18:39:07.554387 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:07.554345 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" event={"ID":"c6133aeb-3abf-40a7-8958-3864004f6fb3","Type":"ContainerStarted","Data":"d6429d1e16d470c8d8e265052d2e2c7127acedbd3f9362c93847b174577dbbf6"} Jul 01 18:39:07.554959 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:07.554454 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" event={"ID":"c6133aeb-3abf-40a7-8958-3864004f6fb3","Type":"ContainerStarted","Data":"ec28341cde53b34905a6117786ebd666a2c80c82e3ae18650171abf300934ba8"} Jul 01 18:39:07.554959 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:07.554600 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:39:07.600263 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:07.600197 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" podStartSLOduration=4.81922967 podStartE2EDuration="9.600178093s" totalImagesPullingTime="4.780948423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:07.596072669 +0000 UTC m=+109.115852077" watchObservedRunningTime="2026-07-01 18:39:07.600178093 +0000 UTC m=+109.119957490" Jul 01 18:39:13.564679 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:13.564643 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59774b7cd7-7bzpv" Jul 01 18:39:27.630456 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:27.630374 2565 generic.go:356] "Generic (PLEG): container finished" podID="28bfb98e-1d2d-486e-b79e-1e1740cd3c60" containerID="9b78054d7f259d2edf234741a61a9f9d51150a2567895312d9853bcf69ff13ae" exitCode=0 Jul 01 18:39:27.630456 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:27.630423 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" event={"ID":"28bfb98e-1d2d-486e-b79e-1e1740cd3c60","Type":"ContainerDied","Data":"9b78054d7f259d2edf234741a61a9f9d51150a2567895312d9853bcf69ff13ae"} Jul 01 18:39:27.630900 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:27.630734 2565 scope.go:117] "RemoveContainer" containerID="9b78054d7f259d2edf234741a61a9f9d51150a2567895312d9853bcf69ff13ae" Jul 01 18:39:28.635579 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:28.635546 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-xvtrp" event={"ID":"28bfb98e-1d2d-486e-b79e-1e1740cd3c60","Type":"ContainerStarted","Data":"a3bc264359989850b07d209830b096913782f6d01159d8bf9eb0b0af0518c858"} Jul 01 18:39:28.740393 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:28.740353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:39:28.742693 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:28.742672 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6-metrics-certs\") pod \"network-metrics-daemon-g5l67\" (UID: \"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6\") " pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:39:29.023706 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:29.023668 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t4jbq\"" Jul 01 18:39:29.030737 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:29.030714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g5l67" Jul 01 18:39:29.187011 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:29.186987 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g5l67"] Jul 01 18:39:29.189048 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:39:29.189025 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92b8cd7_edc3_4ef9_a79d_f9b0dc5445f6.slice/crio-4cb5b5db908526510444b6c2e6415c8249a2b34d10c20e76a0a8a4ff4cf7fd8c WatchSource:0}: Error finding container 4cb5b5db908526510444b6c2e6415c8249a2b34d10c20e76a0a8a4ff4cf7fd8c: Status 404 returned error can't find the container with id 4cb5b5db908526510444b6c2e6415c8249a2b34d10c20e76a0a8a4ff4cf7fd8c Jul 01 18:39:29.639898 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:29.639861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5l67" event={"ID":"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6","Type":"ContainerStarted","Data":"4cb5b5db908526510444b6c2e6415c8249a2b34d10c20e76a0a8a4ff4cf7fd8c"} Jul 01 18:39:31.648910 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:31.648872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5l67" event={"ID":"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6","Type":"ContainerStarted","Data":"b08690d04cd5bfe927c6193a96001387710b30f655928df1f873bd8e60dc01e4"} Jul 01 18:39:31.649301 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:31.648973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g5l67" event={"ID":"b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6","Type":"ContainerStarted","Data":"158a71d6f804edb7834369d16c44f99b3c15e17969bbec004ecfc5fd547d30c1"} Jul 01 18:39:31.676107 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:31.676041 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g5l67" podStartSLOduration=129.212708728 podStartE2EDuration="2m10.676025126s" totalImagesPullingTime="1.463316398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:31.673386693 +0000 UTC m=+133.193166091" watchObservedRunningTime="2026-07-01 18:39:31.676025126 +0000 UTC m=+133.195804553" Jul 01 18:39:36.674605 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:36.674518 2565 generic.go:356] "Generic (PLEG): container finished" podID="77fda808-a14a-4626-81b9-d0b4b1291e33" containerID="e74db3c963e6b745e0eb2f1514f855d64dd45d451d08f69fbf9c0e2b2a2c257e" exitCode=0 Jul 01 18:39:36.674605 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:36.674568 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-d4jxj" event={"ID":"77fda808-a14a-4626-81b9-d0b4b1291e33","Type":"ContainerDied","Data":"e74db3c963e6b745e0eb2f1514f855d64dd45d451d08f69fbf9c0e2b2a2c257e"} Jul 01 18:39:36.675074 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:36.674931 2565 scope.go:117] "RemoveContainer" containerID="e74db3c963e6b745e0eb2f1514f855d64dd45d451d08f69fbf9c0e2b2a2c257e" Jul 01 18:39:37.680300 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:37.680265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-d4jxj" event={"ID":"77fda808-a14a-4626-81b9-d0b4b1291e33","Type":"ContainerStarted","Data":"f2a6981f7ed4dec408d5ceae1f8a1b52ceb078e27b8f0db29403799ade07b488"} Jul 01 18:39:43.704344 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:43.704310 2565 generic.go:356] "Generic (PLEG): container finished" podID="45a7b0d9-b228-4edc-a12c-784601bf03f2" containerID="857f7f518a40a730bd51ecb91fd968bb10ec8defba1f0641c6c8777b1209a070" exitCode=0 Jul 01 18:39:43.704785 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:43.704367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" event={"ID":"45a7b0d9-b228-4edc-a12c-784601bf03f2","Type":"ContainerDied","Data":"857f7f518a40a730bd51ecb91fd968bb10ec8defba1f0641c6c8777b1209a070"} Jul 01 18:39:43.704785 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:43.704711 2565 scope.go:117] "RemoveContainer" containerID="857f7f518a40a730bd51ecb91fd968bb10ec8defba1f0641c6c8777b1209a070" Jul 01 18:39:44.709942 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:39:44.709908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-vw6xd" event={"ID":"45a7b0d9-b228-4edc-a12c-784601bf03f2","Type":"ContainerStarted","Data":"aa592e976db7fea7bcbbee877a8c23846fc1d83f68f2fe24a251e885368a5a56"} Jul 01 18:42:19.834724 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:19.834690 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:42:19.839924 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:19.839897 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:42:19.840145 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:19.840128 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:42:19.844499 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:19.844478 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:42:19.846301 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:19.846279 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 18:42:46.023844 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.023810 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b"] Jul 01 18:42:46.026241 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.026224 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.028677 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.028646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.028803 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.028683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.028803 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.028706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbgvl\" (UniqueName: \"kubernetes.io/projected/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-kube-api-access-gbgvl\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.031352 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.031335 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r6vmg\"" Jul 01 18:42:46.032024 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.032007 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 18:42:46.032107 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.032025 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 18:42:46.042381 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.042347 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b"] Jul 01 18:42:46.129708 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.129669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.129886 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.129720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.129886 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.129750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbgvl\" (UniqueName: \"kubernetes.io/projected/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-kube-api-access-gbgvl\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.130144 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.130127 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.130191 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.130139 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.144346 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.144313 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbgvl\" (UniqueName: \"kubernetes.io/projected/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-kube-api-access-gbgvl\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.335839 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.335755 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:42:46.470043 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.470018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b"] Jul 01 18:42:46.472818 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:42:46.472793 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93d1449_ce07_46f0_a9bf_5dfc8ac52db7.slice/crio-a4f9e07272d03ff4cd3dadc0a7674c01c327e4c7745da539eebe84311e018ea2 WatchSource:0}: Error finding container a4f9e07272d03ff4cd3dadc0a7674c01c327e4c7745da539eebe84311e018ea2: Status 404 returned error can't find the container with id a4f9e07272d03ff4cd3dadc0a7674c01c327e4c7745da539eebe84311e018ea2 Jul 01 18:42:46.475169 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:46.475149 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:42:47.382101 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:47.382069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" event={"ID":"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7","Type":"ContainerStarted","Data":"a4f9e07272d03ff4cd3dadc0a7674c01c327e4c7745da539eebe84311e018ea2"} Jul 01 18:42:54.412630 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:54.412592 2565 generic.go:356] "Generic (PLEG): container finished" podID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerID="56325bcdf2f67566ecb2417a308539b96be37a8c2272bf3952398cda694529b7" exitCode=0 Jul 01 18:42:54.413019 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:54.412652 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" event={"ID":"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7","Type":"ContainerDied","Data":"56325bcdf2f67566ecb2417a308539b96be37a8c2272bf3952398cda694529b7"} Jul 01 18:42:57.428283 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:57.428245 2565 generic.go:356] "Generic (PLEG): container finished" podID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerID="f915c6340bfb1478c9a33ec3c6e9c9869d309517db2edf6e417ba19ec29c1020" exitCode=0 Jul 01 18:42:57.428688 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:42:57.428333 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" event={"ID":"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7","Type":"ContainerDied","Data":"f915c6340bfb1478c9a33ec3c6e9c9869d309517db2edf6e417ba19ec29c1020"} Jul 01 18:43:05.465400 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:05.465357 2565 generic.go:356] "Generic (PLEG): container finished" podID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerID="6859feee423b2e0568f7055762185f78baa2559f6c2a9bcf9215c24467b94e65" exitCode=0 Jul 01 18:43:05.465814 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:05.465404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" event={"ID":"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7","Type":"ContainerDied","Data":"6859feee423b2e0568f7055762185f78baa2559f6c2a9bcf9215c24467b94e65"} Jul 01 18:43:06.595824 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.595800 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:43:06.682151 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.682118 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-util\") pod \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " Jul 01 18:43:06.682151 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.682157 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbgvl\" (UniqueName: \"kubernetes.io/projected/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-kube-api-access-gbgvl\") pod \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " Jul 01 18:43:06.682371 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.682195 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-bundle\") pod \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\" (UID: \"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7\") " Jul 01 18:43:06.682884 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.682847 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-bundle" (OuterVolumeSpecName: "bundle") pod "e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" (UID: "e93d1449-ce07-46f0-a9bf-5dfc8ac52db7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:43:06.684400 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.684377 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-kube-api-access-gbgvl" (OuterVolumeSpecName: "kube-api-access-gbgvl") pod "e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" (UID: "e93d1449-ce07-46f0-a9bf-5dfc8ac52db7"). InnerVolumeSpecName "kube-api-access-gbgvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:43:06.686401 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.686378 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-util" (OuterVolumeSpecName: "util") pod "e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" (UID: "e93d1449-ce07-46f0-a9bf-5dfc8ac52db7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:43:06.782777 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.782678 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-bundle\") on node \"ip-10-0-141-230.ec2.internal\" DevicePath \"\"" Jul 01 18:43:06.782777 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.782718 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-util\") on node \"ip-10-0-141-230.ec2.internal\" DevicePath \"\"" Jul 01 18:43:06.782777 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:06.782728 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbgvl\" (UniqueName: \"kubernetes.io/projected/e93d1449-ce07-46f0-a9bf-5dfc8ac52db7-kube-api-access-gbgvl\") on node \"ip-10-0-141-230.ec2.internal\" DevicePath \"\"" Jul 01 18:43:07.475250 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:07.475216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" event={"ID":"e93d1449-ce07-46f0-a9bf-5dfc8ac52db7","Type":"ContainerDied","Data":"a4f9e07272d03ff4cd3dadc0a7674c01c327e4c7745da539eebe84311e018ea2"} Jul 01 18:43:07.475395 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:07.475263 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4f9e07272d03ff4cd3dadc0a7674c01c327e4c7745da539eebe84311e018ea2" Jul 01 18:43:07.475395 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:07.475266 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wkb2b" Jul 01 18:43:14.008860 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.008825 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz"] Jul 01 18:43:14.009367 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.009116 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerName="extract" Jul 01 18:43:14.009367 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.009126 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerName="extract" Jul 01 18:43:14.009367 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.009137 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerName="pull" Jul 01 18:43:14.009367 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.009142 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerName="pull" Jul 01 18:43:14.009367 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.009153 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerName="util" Jul 01 18:43:14.009367 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.009159 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerName="util" Jul 01 18:43:14.009367 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.009205 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e93d1449-ce07-46f0-a9bf-5dfc8ac52db7" containerName="extract" Jul 01 18:43:14.011765 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.011746 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.016818 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.016795 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 01 18:43:14.016973 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.016879 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-fjvfl\"" Jul 01 18:43:14.017040 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.017023 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 01 18:43:14.017236 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.017222 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 01 18:43:14.029430 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.029397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz"] Jul 01 18:43:14.044244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.044216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8xw\" (UniqueName: \"kubernetes.io/projected/8a3f9839-c1f6-4005-acfe-fb87b8f05d80-kube-api-access-sl8xw\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-brgwz\" (UID: \"8a3f9839-c1f6-4005-acfe-fb87b8f05d80\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.044406 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.044268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8a3f9839-c1f6-4005-acfe-fb87b8f05d80-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-brgwz\" (UID: \"8a3f9839-c1f6-4005-acfe-fb87b8f05d80\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.145020 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.144988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8a3f9839-c1f6-4005-acfe-fb87b8f05d80-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-brgwz\" (UID: \"8a3f9839-c1f6-4005-acfe-fb87b8f05d80\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.145218 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.145054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8xw\" (UniqueName: \"kubernetes.io/projected/8a3f9839-c1f6-4005-acfe-fb87b8f05d80-kube-api-access-sl8xw\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-brgwz\" (UID: \"8a3f9839-c1f6-4005-acfe-fb87b8f05d80\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.147352 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.147325 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8a3f9839-c1f6-4005-acfe-fb87b8f05d80-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-brgwz\" (UID: \"8a3f9839-c1f6-4005-acfe-fb87b8f05d80\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.155662 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.155638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8xw\" (UniqueName: \"kubernetes.io/projected/8a3f9839-c1f6-4005-acfe-fb87b8f05d80-kube-api-access-sl8xw\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-brgwz\" (UID: \"8a3f9839-c1f6-4005-acfe-fb87b8f05d80\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.322217 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.322125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:14.483804 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.483779 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz"] Jul 01 18:43:14.485885 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:43:14.485861 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3f9839_c1f6_4005_acfe_fb87b8f05d80.slice/crio-8f7dd3429951826f40de7f7442722e544c94e705eb1fb525ac8a326063ec0907 WatchSource:0}: Error finding container 8f7dd3429951826f40de7f7442722e544c94e705eb1fb525ac8a326063ec0907: Status 404 returned error can't find the container with id 8f7dd3429951826f40de7f7442722e544c94e705eb1fb525ac8a326063ec0907 Jul 01 18:43:14.503684 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:14.503654 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" event={"ID":"8a3f9839-c1f6-4005-acfe-fb87b8f05d80","Type":"ContainerStarted","Data":"8f7dd3429951826f40de7f7442722e544c94e705eb1fb525ac8a326063ec0907"} Jul 01 18:43:18.522471 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:18.522368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" event={"ID":"8a3f9839-c1f6-4005-acfe-fb87b8f05d80","Type":"ContainerStarted","Data":"5b1f265f6657473f2d781983cce4f47815c2e28ba1d43e326fe9faa0c40a748b"} Jul 01 18:43:18.522912 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:18.522483 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:18.552421 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:18.552362 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" podStartSLOduration=1.769927498 podStartE2EDuration="5.552329576s" totalImagesPullingTime="3.782402078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:43:18.549548539 +0000 UTC m=+360.069327951" watchObservedRunningTime="2026-07-01 18:43:18.552329576 +0000 UTC m=+360.072108973" Jul 01 18:43:19.220800 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.220764 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-g2v8j"] Jul 01 18:43:19.224026 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.224010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.228220 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.228193 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 01 18:43:19.228839 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.228815 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 01 18:43:19.228839 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.228834 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-mhgqz\"" Jul 01 18:43:19.240530 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.240503 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-g2v8j"] Jul 01 18:43:19.287154 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.287121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-kube-api-access-86kqx\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.287154 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.287157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-certificates\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.287388 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.287185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/918a1ce1-a871-4381-9df0-782d8b242c60-cabundle0\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.388390 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.388347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-kube-api-access-86kqx\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.388390 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.388385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-certificates\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.388686 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.388418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/918a1ce1-a871-4381-9df0-782d8b242c60-cabundle0\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.388686 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:19.388529 2565 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 01 18:43:19.388686 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:19.388550 2565 secret.go:281] references non-existent secret key: ca.crt Jul 01 18:43:19.388686 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:19.388557 2565 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 01 18:43:19.388686 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:19.388569 2565 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-g2v8j: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 01 18:43:19.388686 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:19.388660 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-certificates podName:918a1ce1-a871-4381-9df0-782d8b242c60 nodeName:}" failed. No retries permitted until 2026-07-01 18:43:19.888638418 +0000 UTC m=+361.408417806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-certificates") pod "keda-operator-68bff59c-g2v8j" (UID: "918a1ce1-a871-4381-9df0-782d8b242c60") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 01 18:43:19.389089 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.389069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/918a1ce1-a871-4381-9df0-782d8b242c60-cabundle0\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.410444 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.410415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-kube-api-access-86kqx\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.892947 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.892903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-certificates\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.895481 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.895455 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/918a1ce1-a871-4381-9df0-782d8b242c60-certificates\") pod \"keda-operator-68bff59c-g2v8j\" (UID: \"918a1ce1-a871-4381-9df0-782d8b242c60\") " pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:19.903144 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.903120 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8"] Jul 01 18:43:19.906475 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.906459 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:19.910008 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.909978 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 01 18:43:19.924318 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.924287 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8"] Jul 01 18:43:19.993691 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.993658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-certificates\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:19.993873 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.993742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:19.993873 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:19.993776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wttb2\" (UniqueName: \"kubernetes.io/projected/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-kube-api-access-wttb2\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.094314 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.094280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.094499 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.094321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wttb2\" (UniqueName: \"kubernetes.io/projected/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-kube-api-access-wttb2\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.094499 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.094365 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-certificates\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.094811 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.094789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.096907 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.096888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-certificates\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.113654 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.113612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wttb2\" (UniqueName: \"kubernetes.io/projected/6cf1cd7a-d3a1-4252-8734-e74a71405d8f-kube-api-access-wttb2\") pod \"keda-metrics-apiserver-559f75f947-f5rz8\" (UID: \"6cf1cd7a-d3a1-4252-8734-e74a71405d8f\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.125370 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.125341 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vdhcz"] Jul 01 18:43:20.128526 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.128510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:20.132611 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.132586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 01 18:43:20.136904 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.136884 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-mhgqz\"" Jul 01 18:43:20.144198 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.144144 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:20.153199 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.153175 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vdhcz"] Jul 01 18:43:20.195829 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.195792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-certificates\") pod \"keda-admission-5fbd5c4644-vdhcz\" (UID: \"30a612d5-41dd-4b65-8341-d1c582c99ea0\") " pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:20.196009 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.195978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2k75\" (UniqueName: \"kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-kube-api-access-z2k75\") pod \"keda-admission-5fbd5c4644-vdhcz\" (UID: \"30a612d5-41dd-4b65-8341-d1c582c99ea0\") " pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:20.218678 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.218644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:20.297549 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.297506 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-certificates\") pod \"keda-admission-5fbd5c4644-vdhcz\" (UID: \"30a612d5-41dd-4b65-8341-d1c582c99ea0\") " pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:20.297746 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.297587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2k75\" (UniqueName: \"kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-kube-api-access-z2k75\") pod \"keda-admission-5fbd5c4644-vdhcz\" (UID: \"30a612d5-41dd-4b65-8341-d1c582c99ea0\") " pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:20.297746 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:20.297694 2565 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 01 18:43:20.297746 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:20.297724 2565 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-vdhcz: secret "keda-admission-webhooks-certs" not found Jul 01 18:43:20.297915 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:43:20.297790 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-certificates podName:30a612d5-41dd-4b65-8341-d1c582c99ea0 nodeName:}" failed. No retries permitted until 2026-07-01 18:43:20.797768874 +0000 UTC m=+362.317548250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-certificates") pod "keda-admission-5fbd5c4644-vdhcz" (UID: "30a612d5-41dd-4b65-8341-d1c582c99ea0") : secret "keda-admission-webhooks-certs" not found Jul 01 18:43:20.326293 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.326262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2k75\" (UniqueName: \"kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-kube-api-access-z2k75\") pod \"keda-admission-5fbd5c4644-vdhcz\" (UID: \"30a612d5-41dd-4b65-8341-d1c582c99ea0\") " pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:20.354198 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.354159 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-g2v8j"] Jul 01 18:43:20.358544 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:43:20.358517 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918a1ce1_a871_4381_9df0_782d8b242c60.slice/crio-62aca5d4f7158e16fb407beb6619bd5074d20f347a0c2907065fe4347c53fb43 WatchSource:0}: Error finding container 62aca5d4f7158e16fb407beb6619bd5074d20f347a0c2907065fe4347c53fb43: Status 404 returned error can't find the container with id 62aca5d4f7158e16fb407beb6619bd5074d20f347a0c2907065fe4347c53fb43 Jul 01 18:43:20.379134 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.379108 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8"] Jul 01 18:43:20.381134 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:43:20.381102 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf1cd7a_d3a1_4252_8734_e74a71405d8f.slice/crio-b79c9d3f874be47b0601a151c1bf62ed033d3c8e0f72f3feff42a5abbb709e36 WatchSource:0}: Error finding container b79c9d3f874be47b0601a151c1bf62ed033d3c8e0f72f3feff42a5abbb709e36: Status 404 returned error can't find the container with id b79c9d3f874be47b0601a151c1bf62ed033d3c8e0f72f3feff42a5abbb709e36 Jul 01 18:43:20.532321 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.532287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" event={"ID":"6cf1cd7a-d3a1-4252-8734-e74a71405d8f","Type":"ContainerStarted","Data":"b79c9d3f874be47b0601a151c1bf62ed033d3c8e0f72f3feff42a5abbb709e36"} Jul 01 18:43:20.533477 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.533448 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-g2v8j" event={"ID":"918a1ce1-a871-4381-9df0-782d8b242c60","Type":"ContainerStarted","Data":"62aca5d4f7158e16fb407beb6619bd5074d20f347a0c2907065fe4347c53fb43"} Jul 01 18:43:20.801915 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.801834 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-certificates\") pod \"keda-admission-5fbd5c4644-vdhcz\" (UID: \"30a612d5-41dd-4b65-8341-d1c582c99ea0\") " pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:20.804250 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:20.804221 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30a612d5-41dd-4b65-8341-d1c582c99ea0-certificates\") pod \"keda-admission-5fbd5c4644-vdhcz\" (UID: \"30a612d5-41dd-4b65-8341-d1c582c99ea0\") " pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:21.038730 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:21.038694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:21.224723 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:21.224690 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vdhcz"] Jul 01 18:43:21.236370 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:43:21.236342 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a612d5_41dd_4b65_8341_d1c582c99ea0.slice/crio-31a23b64fbb0ca2f1a8e95789fb18288c886ac85cea2e8fecaa1f26a2322947a WatchSource:0}: Error finding container 31a23b64fbb0ca2f1a8e95789fb18288c886ac85cea2e8fecaa1f26a2322947a: Status 404 returned error can't find the container with id 31a23b64fbb0ca2f1a8e95789fb18288c886ac85cea2e8fecaa1f26a2322947a Jul 01 18:43:21.540231 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:21.540185 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" event={"ID":"30a612d5-41dd-4b65-8341-d1c582c99ea0","Type":"ContainerStarted","Data":"31a23b64fbb0ca2f1a8e95789fb18288c886ac85cea2e8fecaa1f26a2322947a"} Jul 01 18:43:25.563054 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.562944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-g2v8j" event={"ID":"918a1ce1-a871-4381-9df0-782d8b242c60","Type":"ContainerStarted","Data":"ae48b0a4b66dcb90f52d9178135035327a1f3e008637900c46f4f1576ccf7b19"} Jul 01 18:43:25.563054 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.563046 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:25.564565 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.564536 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" event={"ID":"30a612d5-41dd-4b65-8341-d1c582c99ea0","Type":"ContainerStarted","Data":"45758071519d3edc861d35d368a248bfada07e77901c3f2cee0dfcf6936bc340"} Jul 01 18:43:25.564736 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.564642 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:43:25.566203 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.566176 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" event={"ID":"6cf1cd7a-d3a1-4252-8734-e74a71405d8f","Type":"ContainerStarted","Data":"88e4c9ebc9ec082618b5395187da408be92cbb4d7e6ecd43af2433690bc5f03d"} Jul 01 18:43:25.566311 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.566293 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:25.585746 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.585688 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-g2v8j" podStartSLOduration=1.614911766 podStartE2EDuration="6.585667878s" totalImagesPullingTime="4.970756112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:43:25.583488328 +0000 UTC m=+367.103267726" watchObservedRunningTime="2026-07-01 18:43:25.585667878 +0000 UTC m=+367.105447293" Jul 01 18:43:25.604314 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.604247 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" podStartSLOduration=1.667012906 podStartE2EDuration="6.604232687s" totalImagesPullingTime="4.937219781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:43:25.603337198 +0000 UTC m=+367.123116596" watchObservedRunningTime="2026-07-01 18:43:25.604232687 +0000 UTC m=+367.124012084" Jul 01 18:43:25.624176 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:25.624115 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" podStartSLOduration=1.534532334 podStartE2EDuration="5.62409409s" totalImagesPullingTime="4.089561756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:43:25.623163459 +0000 UTC m=+367.142942868" watchObservedRunningTime="2026-07-01 18:43:25.62409409 +0000 UTC m=+367.143873492" Jul 01 18:43:36.575347 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:36.575311 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-f5rz8" Jul 01 18:43:39.529884 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:39.529854 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-brgwz" Jul 01 18:43:46.572972 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:46.572938 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-g2v8j" Jul 01 18:43:46.573547 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:43:46.573024 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-vdhcz" Jul 01 18:44:28.101754 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.101721 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-q4glc"] Jul 01 18:44:28.104087 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.104070 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.109135 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.109099 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 18:44:28.109322 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.109170 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-f5fqh\"" Jul 01 18:44:28.110706 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.110685 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 18:44:28.110981 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.110957 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 18:44:28.126826 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.126799 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-q4glc"] Jul 01 18:44:28.149455 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.149424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn272\" (UniqueName: \"kubernetes.io/projected/4721adb4-629a-472e-bb97-f2d67356775e-kube-api-access-sn272\") pod \"seaweedfs-64568bcd49-q4glc\" (UID: \"4721adb4-629a-472e-bb97-f2d67356775e\") " pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.149605 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.149495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4721adb4-629a-472e-bb97-f2d67356775e-data\") pod \"seaweedfs-64568bcd49-q4glc\" (UID: \"4721adb4-629a-472e-bb97-f2d67356775e\") " pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.250173 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.250139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4721adb4-629a-472e-bb97-f2d67356775e-data\") pod \"seaweedfs-64568bcd49-q4glc\" (UID: \"4721adb4-629a-472e-bb97-f2d67356775e\") " pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.250352 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.250196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn272\" (UniqueName: \"kubernetes.io/projected/4721adb4-629a-472e-bb97-f2d67356775e-kube-api-access-sn272\") pod \"seaweedfs-64568bcd49-q4glc\" (UID: \"4721adb4-629a-472e-bb97-f2d67356775e\") " pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.250565 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.250544 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4721adb4-629a-472e-bb97-f2d67356775e-data\") pod \"seaweedfs-64568bcd49-q4glc\" (UID: \"4721adb4-629a-472e-bb97-f2d67356775e\") " pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.264714 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.264690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn272\" (UniqueName: \"kubernetes.io/projected/4721adb4-629a-472e-bb97-f2d67356775e-kube-api-access-sn272\") pod \"seaweedfs-64568bcd49-q4glc\" (UID: \"4721adb4-629a-472e-bb97-f2d67356775e\") " pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.413610 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.413572 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:28.558286 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.558249 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-q4glc"] Jul 01 18:44:28.561158 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:44:28.561131 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4721adb4_629a_472e_bb97_f2d67356775e.slice/crio-7f1db9e38cf1199cafd244c0e593d2c462e72d4ffd88ff419746af21a1f84992 WatchSource:0}: Error finding container 7f1db9e38cf1199cafd244c0e593d2c462e72d4ffd88ff419746af21a1f84992: Status 404 returned error can't find the container with id 7f1db9e38cf1199cafd244c0e593d2c462e72d4ffd88ff419746af21a1f84992 Jul 01 18:44:28.831120 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:28.831036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-q4glc" event={"ID":"4721adb4-629a-472e-bb97-f2d67356775e","Type":"ContainerStarted","Data":"7f1db9e38cf1199cafd244c0e593d2c462e72d4ffd88ff419746af21a1f84992"} Jul 01 18:44:32.851065 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:32.851026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-q4glc" event={"ID":"4721adb4-629a-472e-bb97-f2d67356775e","Type":"ContainerStarted","Data":"0bf5766e6495ce6da9ad814b4497d0b7c153440c10212fd49c1ab451b42d3e67"} Jul 01 18:44:32.851445 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:32.851160 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:38.858884 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:38.858858 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-q4glc" Jul 01 18:44:38.894823 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:44:38.894776 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-q4glc" podStartSLOduration=7.243498801 podStartE2EDuration="10.894760495s" totalImagesPullingTime="3.651261694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:44:32.88172664 +0000 UTC m=+434.401506048" watchObservedRunningTime="2026-07-01 18:44:38.894760495 +0000 UTC m=+440.414539892" Jul 01 18:47:19.862259 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:47:19.862227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:47:19.866495 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:47:19.866470 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:47:19.867200 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:47:19.867180 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:47:19.871688 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:47:19.871668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:50:49.806147 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.806070 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8"] Jul 01 18:50:49.809428 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.809405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:49.812729 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.812703 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 18:50:49.812960 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.812774 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-97f72-serving-cert\"" Jul 01 18:50:49.813090 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.812843 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-64f2j\"" Jul 01 18:50:49.814018 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.813994 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-97f72-kube-rbac-proxy-sar-config\"" Jul 01 18:50:49.819883 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.819862 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8"] Jul 01 18:50:49.911421 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.911389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4abdea69-61fb-40e5-9f46-2295b4565950-proxy-tls\") pod \"model-chainer-raw-97f72-57b966f8-bbbx8\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:49.911703 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:49.911454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abdea69-61fb-40e5-9f46-2295b4565950-openshift-service-ca-bundle\") pod \"model-chainer-raw-97f72-57b966f8-bbbx8\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:50.012074 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.012035 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abdea69-61fb-40e5-9f46-2295b4565950-openshift-service-ca-bundle\") pod \"model-chainer-raw-97f72-57b966f8-bbbx8\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:50.012364 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.012093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4abdea69-61fb-40e5-9f46-2295b4565950-proxy-tls\") pod \"model-chainer-raw-97f72-57b966f8-bbbx8\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:50.012884 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.012857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abdea69-61fb-40e5-9f46-2295b4565950-openshift-service-ca-bundle\") pod \"model-chainer-raw-97f72-57b966f8-bbbx8\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:50.014729 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.014707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4abdea69-61fb-40e5-9f46-2295b4565950-proxy-tls\") pod \"model-chainer-raw-97f72-57b966f8-bbbx8\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:50.124476 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.124382 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:50.268858 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.268832 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8"] Jul 01 18:50:50.271014 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:50:50.270981 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abdea69_61fb_40e5_9f46_2295b4565950.slice/crio-8a9e17b00d0d27ff730898468513807772f081205a7ac59d42935aa66ecaa854 WatchSource:0}: Error finding container 8a9e17b00d0d27ff730898468513807772f081205a7ac59d42935aa66ecaa854: Status 404 returned error can't find the container with id 8a9e17b00d0d27ff730898468513807772f081205a7ac59d42935aa66ecaa854 Jul 01 18:50:50.272905 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.272888 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:50:50.448503 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:50.448462 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" event={"ID":"4abdea69-61fb-40e5-9f46-2295b4565950","Type":"ContainerStarted","Data":"8a9e17b00d0d27ff730898468513807772f081205a7ac59d42935aa66ecaa854"} Jul 01 18:50:53.464051 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:53.464016 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" event={"ID":"4abdea69-61fb-40e5-9f46-2295b4565950","Type":"ContainerStarted","Data":"7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c"} Jul 01 18:50:53.464546 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:53.464153 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:53.486524 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:53.486474 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podStartSLOduration=1.93919644 podStartE2EDuration="4.486458041s" totalImagesPullingTime="2.547261601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:50:53.48569909 +0000 UTC m=+815.005478490" watchObservedRunningTime="2026-07-01 18:50:53.486458041 +0000 UTC m=+815.006237438" Jul 01 18:50:59.474316 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:59.474287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:50:59.844665 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:59.844578 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8"] Jul 01 18:50:59.844797 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:50:59.844777 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" containerID="cri-o://7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c" gracePeriod=30 Jul 01 18:51:04.472036 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:04.471992 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:51:09.472642 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:09.472577 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:51:14.472371 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:14.472328 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:51:14.472779 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:14.472430 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:51:19.472551 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:19.472515 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:51:24.472790 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:24.472747 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:51:29.472489 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:29.472449 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:51:30.497709 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.497678 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:51:30.529868 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.529830 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abdea69-61fb-40e5-9f46-2295b4565950-openshift-service-ca-bundle\") pod \"4abdea69-61fb-40e5-9f46-2295b4565950\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " Jul 01 18:51:30.530042 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.529898 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4abdea69-61fb-40e5-9f46-2295b4565950-proxy-tls\") pod \"4abdea69-61fb-40e5-9f46-2295b4565950\" (UID: \"4abdea69-61fb-40e5-9f46-2295b4565950\") " Jul 01 18:51:30.530276 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.530247 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4abdea69-61fb-40e5-9f46-2295b4565950-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4abdea69-61fb-40e5-9f46-2295b4565950" (UID: "4abdea69-61fb-40e5-9f46-2295b4565950"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:51:30.532048 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.532024 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4abdea69-61fb-40e5-9f46-2295b4565950-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4abdea69-61fb-40e5-9f46-2295b4565950" (UID: "4abdea69-61fb-40e5-9f46-2295b4565950"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:51:30.630549 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.630458 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abdea69-61fb-40e5-9f46-2295b4565950-openshift-service-ca-bundle\") on node \"ip-10-0-141-230.ec2.internal\" DevicePath \"\"" Jul 01 18:51:30.630549 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.630486 2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4abdea69-61fb-40e5-9f46-2295b4565950-proxy-tls\") on node \"ip-10-0-141-230.ec2.internal\" DevicePath \"\"" Jul 01 18:51:30.631411 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.631386 2565 generic.go:356] "Generic (PLEG): container finished" podID="4abdea69-61fb-40e5-9f46-2295b4565950" containerID="7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c" exitCode=0 Jul 01 18:51:30.631744 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.631426 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" Jul 01 18:51:30.631744 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.631429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" event={"ID":"4abdea69-61fb-40e5-9f46-2295b4565950","Type":"ContainerDied","Data":"7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c"} Jul 01 18:51:30.631744 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.631493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8" event={"ID":"4abdea69-61fb-40e5-9f46-2295b4565950","Type":"ContainerDied","Data":"8a9e17b00d0d27ff730898468513807772f081205a7ac59d42935aa66ecaa854"} Jul 01 18:51:30.631744 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.631521 2565 scope.go:117] "RemoveContainer" containerID="7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c" Jul 01 18:51:30.640322 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.640305 2565 scope.go:117] "RemoveContainer" containerID="7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c" Jul 01 18:51:30.640637 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:51:30.640593 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c\": container with ID starting with 7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c not found: ID does not exist" containerID="7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c" Jul 01 18:51:30.640715 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.640640 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c"} err="failed to get container status \"7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c\": rpc error: code = NotFound desc = could not find container \"7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c\": container with ID starting with 7629b18c8a9817857d2dca6aba61eca0e1c846748c065a20a49eeb6178d6658c not found: ID does not exist" Jul 01 18:51:30.656081 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.656055 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8"] Jul 01 18:51:30.664753 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:30.664727 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-97f72-57b966f8-bbbx8"] Jul 01 18:51:31.902797 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:51:31.902764 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" path="/var/lib/kubelet/pods/4abdea69-61fb-40e5-9f46-2295b4565950/volumes" Jul 01 18:52:19.894040 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:19.894013 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:52:19.894833 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:19.894816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:52:19.900580 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:19.900548 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:52:19.901506 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:19.901484 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:52:40.109460 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.109425 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l"] Jul 01 18:52:40.109869 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.109749 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" Jul 01 18:52:40.109869 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.109760 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" Jul 01 18:52:40.109869 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.109827 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4abdea69-61fb-40e5-9f46-2295b4565950" containerName="model-chainer-raw-97f72" Jul 01 18:52:40.113832 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.113815 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:40.117946 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.117909 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-e8497-kube-rbac-proxy-sar-config\"" Jul 01 18:52:40.118196 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.117962 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 18:52:40.118196 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.117977 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-64f2j\"" Jul 01 18:52:40.118196 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.117993 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-e8497-serving-cert\"" Jul 01 18:52:40.122293 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.121737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l"] Jul 01 18:52:40.205345 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.205312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls\") pod \"model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:40.205529 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.205379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:40.306809 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.306767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls\") pod \"model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:40.306976 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.306836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:40.306976 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:52:40.306926 2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-serving-cert: secret "model-chainer-raw-hpa-e8497-serving-cert" not found Jul 01 18:52:40.307093 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:52:40.307029 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls podName:8bd6eac9-11ec-49e5-b8b7-0040967fe7ef nodeName:}" failed. No retries permitted until 2026-07-01 18:52:40.807006926 +0000 UTC m=+922.326786304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls") pod "model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" (UID: "8bd6eac9-11ec-49e5-b8b7-0040967fe7ef") : secret "model-chainer-raw-hpa-e8497-serving-cert" not found Jul 01 18:52:40.307578 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.307557 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:40.812001 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.811962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls\") pod \"model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:40.814337 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:40.814309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls\") pod \"model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:41.026282 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:41.026247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:41.162750 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:41.162714 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l"] Jul 01 18:52:41.165836 ip-10-0-141-230 kubenswrapper[2565]: W0701 18:52:41.165808 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd6eac9_11ec_49e5_b8b7_0040967fe7ef.slice/crio-9929b8d53e55baaa0b8444304a92a544ee0e7533d5282a86a5b92dd75dc3491f WatchSource:0}: Error finding container 9929b8d53e55baaa0b8444304a92a544ee0e7533d5282a86a5b92dd75dc3491f: Status 404 returned error can't find the container with id 9929b8d53e55baaa0b8444304a92a544ee0e7533d5282a86a5b92dd75dc3491f Jul 01 18:52:41.943756 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:41.943723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" event={"ID":"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef","Type":"ContainerStarted","Data":"99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a"} Jul 01 18:52:41.943940 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:41.943775 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" event={"ID":"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef","Type":"ContainerStarted","Data":"9929b8d53e55baaa0b8444304a92a544ee0e7533d5282a86a5b92dd75dc3491f"} Jul 01 18:52:41.943940 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:41.943797 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:41.965309 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:41.965256 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podStartSLOduration=1.965243623 podStartE2EDuration="1.965243623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:52:41.965031021 +0000 UTC m=+923.484810419" watchObservedRunningTime="2026-07-01 18:52:41.965243623 +0000 UTC m=+923.485023020" Jul 01 18:52:47.954115 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:47.954085 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:52:50.154337 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:50.154306 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l"] Jul 01 18:52:50.154772 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:50.154483 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" containerID="cri-o://99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a" gracePeriod=30 Jul 01 18:52:52.952240 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:52.952203 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:52:57.953035 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:52:57.952995 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:53:02.953238 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:02.953189 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:53:02.953727 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:02.953305 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:53:07.952324 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:07.952279 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:53:12.953024 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:12.952981 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:53:17.952636 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:17.952586 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:53:20.298298 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:20.298274 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:53:20.453545 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:20.453454 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-openshift-service-ca-bundle\") pod \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " Jul 01 18:53:20.453545 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:20.453527 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls\") pod \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\" (UID: \"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef\") " Jul 01 18:53:20.453869 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:20.453845 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" (UID: "8bd6eac9-11ec-49e5-b8b7-0040967fe7ef"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:53:20.455648 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:20.455595 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" (UID: "8bd6eac9-11ec-49e5-b8b7-0040967fe7ef"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:53:20.554992 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:20.554956 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-openshift-service-ca-bundle\") on node \"ip-10-0-141-230.ec2.internal\" DevicePath \"\"" Jul 01 18:53:20.554992 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:20.554986 2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef-proxy-tls\") on node \"ip-10-0-141-230.ec2.internal\" DevicePath \"\"" Jul 01 18:53:21.113244 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.113205 2565 generic.go:356] "Generic (PLEG): container finished" podID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerID="99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a" exitCode=0 Jul 01 18:53:21.113433 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.113254 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" Jul 01 18:53:21.113433 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.113303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" event={"ID":"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef","Type":"ContainerDied","Data":"99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a"} Jul 01 18:53:21.113433 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.113355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l" event={"ID":"8bd6eac9-11ec-49e5-b8b7-0040967fe7ef","Type":"ContainerDied","Data":"9929b8d53e55baaa0b8444304a92a544ee0e7533d5282a86a5b92dd75dc3491f"} Jul 01 18:53:21.113433 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.113379 2565 scope.go:117] "RemoveContainer" containerID="99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a" Jul 01 18:53:21.122146 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.122124 2565 scope.go:117] "RemoveContainer" containerID="99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a" Jul 01 18:53:21.122441 ip-10-0-141-230 kubenswrapper[2565]: E0701 18:53:21.122422 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a\": container with ID starting with 99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a not found: ID does not exist" containerID="99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a" Jul 01 18:53:21.122483 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.122449 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a"} err="failed to get container status \"99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a\": rpc error: code = NotFound desc = could not find container \"99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a\": container with ID starting with 99d29ebba830d2b917d3d7abbc43e4ddc3c891661f6166e1c086eaf1ddfbf56a not found: ID does not exist" Jul 01 18:53:21.136458 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.136429 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l"] Jul 01 18:53:21.143325 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.143302 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e8497-5df7857b4d-l9t8l"] Jul 01 18:53:21.902381 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:53:21.902346 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" path="/var/lib/kubelet/pods/8bd6eac9-11ec-49e5-b8b7-0040967fe7ef/volumes" Jul 01 18:57:19.925126 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:57:19.925098 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:57:19.926780 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:57:19.926756 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 18:57:19.930121 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:57:19.930102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 18:57:19.931789 ip-10-0-141-230 kubenswrapper[2565]: I0701 18:57:19.931771 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 19:02:19.952833 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:02:19.952802 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 19:02:19.954711 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:02:19.954688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 19:02:19.957728 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:02:19.957707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 19:02:19.959431 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:02:19.959408 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 19:03:19.249765 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:19.249736 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wj9cb_96a58d9e-0266-4871-94ef-fc8deee52ebb/global-pull-secret-syncer/0.log" Jul 01 19:03:19.347660 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:19.347631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qj9d4_72755299-e3a5-41ee-9a19-2d0272fd44e0/konnectivity-agent/0.log" Jul 01 19:03:19.441895 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:19.441862 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-230.ec2.internal_e0e20c26ce09867b5f1755fe9406cdab/haproxy/0.log" Jul 01 19:03:23.980706 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:23.980670 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kztmh_3311ccbb-6659-4082-ba78-b2ebb24dc3f4/node-exporter/0.log" Jul 01 19:03:24.002888 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.002860 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kztmh_3311ccbb-6659-4082-ba78-b2ebb24dc3f4/kube-rbac-proxy/0.log" Jul 01 19:03:24.036757 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.036732 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kztmh_3311ccbb-6659-4082-ba78-b2ebb24dc3f4/init-textfile/0.log" Jul 01 19:03:24.688480 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.688452 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59774b7cd7-7bzpv_c6133aeb-3abf-40a7-8958-3864004f6fb3/thanos-query/0.log" Jul 01 19:03:24.718363 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.718337 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59774b7cd7-7bzpv_c6133aeb-3abf-40a7-8958-3864004f6fb3/kube-rbac-proxy-web/0.log" Jul 01 19:03:24.747186 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.747159 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59774b7cd7-7bzpv_c6133aeb-3abf-40a7-8958-3864004f6fb3/kube-rbac-proxy/0.log" Jul 01 19:03:24.777009 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.776983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59774b7cd7-7bzpv_c6133aeb-3abf-40a7-8958-3864004f6fb3/prom-label-proxy/0.log" Jul 01 19:03:24.805247 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.805225 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59774b7cd7-7bzpv_c6133aeb-3abf-40a7-8958-3864004f6fb3/kube-rbac-proxy-rules/0.log" Jul 01 19:03:24.836145 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:24.836120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59774b7cd7-7bzpv_c6133aeb-3abf-40a7-8958-3864004f6fb3/kube-rbac-proxy-metrics/0.log" Jul 01 19:03:26.743347 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:26.743314 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/1.log" Jul 01 19:03:26.748787 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:26.748766 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-cwsj6_143a2d25-e82e-4e19-b068-c86262369ffc/console-operator/2.log" Jul 01 19:03:27.015398 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.015319 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls"] Jul 01 19:03:27.015772 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.015755 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" Jul 01 19:03:27.015880 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.015774 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" Jul 01 19:03:27.015880 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.015849 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd6eac9-11ec-49e5-b8b7-0040967fe7ef" containerName="model-chainer-raw-hpa-e8497" Jul 01 19:03:27.018733 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.018708 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.022165 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.022140 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s84nm\"/\"openshift-service-ca.crt\"" Jul 01 19:03:27.022285 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.022140 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s84nm\"/\"default-dockercfg-tmflf\"" Jul 01 19:03:27.023521 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.023505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s84nm\"/\"kube-root-ca.crt\"" Jul 01 19:03:27.029920 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.029899 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls"] Jul 01 19:03:27.096526 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.096496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-sys\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.096526 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.096530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-proc\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.096738 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.096551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-lib-modules\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.096738 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.096593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc5wp\" (UniqueName: \"kubernetes.io/projected/7a98d736-4f34-4939-a579-c20ec852d2a7-kube-api-access-wc5wp\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.096738 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.096680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-podres\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.197989 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.197954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-podres\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198168 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-sys\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198168 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-proc\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198168 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-lib-modules\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198168 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc5wp\" (UniqueName: \"kubernetes.io/projected/7a98d736-4f34-4939-a579-c20ec852d2a7-kube-api-access-wc5wp\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198168 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198095 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-sys\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198168 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198110 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-podres\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198168 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198167 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-proc\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.198464 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.198333 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a98d736-4f34-4939-a579-c20ec852d2a7-lib-modules\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.207700 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.207680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc5wp\" (UniqueName: \"kubernetes.io/projected/7a98d736-4f34-4939-a579-c20ec852d2a7-kube-api-access-wc5wp\") pod \"perf-node-gather-daemonset-qkpls\" (UID: \"7a98d736-4f34-4939-a579-c20ec852d2a7\") " pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.261514 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.261484 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-gtt46_9a618b3e-b569-45d0-8b3d-c398d48a2ec3/download-server/0.log" Jul 01 19:03:27.328268 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.328179 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.461895 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.461872 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls"] Jul 01 19:03:27.463712 ip-10-0-141-230 kubenswrapper[2565]: W0701 19:03:27.463686 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7a98d736_4f34_4939_a579_c20ec852d2a7.slice/crio-70608f577b292698af2cbe6d64c11ed12609a98f89fe0bcbda5513b5211414b0 WatchSource:0}: Error finding container 70608f577b292698af2cbe6d64c11ed12609a98f89fe0bcbda5513b5211414b0: Status 404 returned error can't find the container with id 70608f577b292698af2cbe6d64c11ed12609a98f89fe0bcbda5513b5211414b0 Jul 01 19:03:27.744532 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.744495 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" event={"ID":"7a98d736-4f34-4939-a579-c20ec852d2a7","Type":"ContainerStarted","Data":"b1e80818c31d286dca697c05944c74c2df5df91de7063f1bffdfce482bb36eb4"} Jul 01 19:03:27.745027 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.744547 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" event={"ID":"7a98d736-4f34-4939-a579-c20ec852d2a7","Type":"ContainerStarted","Data":"70608f577b292698af2cbe6d64c11ed12609a98f89fe0bcbda5513b5211414b0"} Jul 01 19:03:27.745027 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.744577 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:27.766707 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.766657 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" podStartSLOduration=1.7666411819999999 podStartE2EDuration="1.766641182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:03:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:03:27.76447619 +0000 UTC m=+1569.284255587" watchObservedRunningTime="2026-07-01 19:03:27.766641182 +0000 UTC m=+1569.286420575" Jul 01 19:03:27.810225 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:27.810201 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-sgwtw_ed517e24-7427-481e-98b6-d43b4847f4a4/volume-data-source-validator/0.log" Jul 01 19:03:28.850023 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:28.849994 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tj6qn_7657be34-01f0-4ad4-a0de-35d55b71065b/dns/0.log" Jul 01 19:03:28.877467 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:28.877439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tj6qn_7657be34-01f0-4ad4-a0de-35d55b71065b/kube-rbac-proxy/0.log" Jul 01 19:03:28.972248 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:28.972218 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vdl8m_f47f7abb-9c3d-4310-bfba-ef66564fd631/dns-node-resolver/0.log" Jul 01 19:03:29.463647 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:29.463510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6ddd8f8646-5rpkd_4eec8612-8959-4895-9e75-dcf657748437/registry/0.log" Jul 01 19:03:29.486253 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:29.486228 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bx8tq_549b51a2-5ce7-4dec-b80b-ed88f88c3b1a/node-ca/0.log" Jul 01 19:03:30.424093 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:30.424063 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c4786ff87-gsp8r_216417e3-c6f2-42d7-9883-963212ccc155/router/0.log" Jul 01 19:03:30.825948 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:30.825856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7ttl8_98d937a2-4285-4a0e-b084-d6d983dcd60b/serve-healthcheck-canary/0.log" Jul 01 19:03:31.260599 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:31.260570 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-d4jxj_77fda808-a14a-4626-81b9-d0b4b1291e33/insights-operator/0.log" Jul 01 19:03:31.260903 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:31.260888 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-d4jxj_77fda808-a14a-4626-81b9-d0b4b1291e33/insights-operator/1.log" Jul 01 19:03:31.373383 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:31.373356 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ms5fr_8ef190ed-55c1-4153-8118-f8452ee70532/kube-rbac-proxy/0.log" Jul 01 19:03:31.397916 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:31.397885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ms5fr_8ef190ed-55c1-4153-8118-f8452ee70532/exporter/0.log" Jul 01 19:03:31.423056 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:31.423027 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ms5fr_8ef190ed-55c1-4153-8118-f8452ee70532/extractor/0.log" Jul 01 19:03:33.759166 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:33.759139 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s84nm/perf-node-gather-daemonset-qkpls" Jul 01 19:03:33.881795 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:33.881766 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-q4glc_4721adb4-629a-472e-bb97-f2d67356775e/seaweedfs/0.log" Jul 01 19:03:38.763608 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:38.763517 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-vw6xd_45a7b0d9-b228-4edc-a12c-784601bf03f2/kube-storage-version-migrator-operator/1.log" Jul 01 19:03:38.764420 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:38.764399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-vw6xd_45a7b0d9-b228-4edc-a12c-784601bf03f2/kube-storage-version-migrator-operator/0.log" Jul 01 19:03:40.106792 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.106765 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qb5z2_37844ed1-4709-4e55-95b1-1e29630de969/kube-multus-additional-cni-plugins/0.log" Jul 01 19:03:40.132855 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.132833 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qb5z2_37844ed1-4709-4e55-95b1-1e29630de969/egress-router-binary-copy/0.log" Jul 01 19:03:40.162003 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.161983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qb5z2_37844ed1-4709-4e55-95b1-1e29630de969/cni-plugins/0.log" Jul 01 19:03:40.189232 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.189203 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qb5z2_37844ed1-4709-4e55-95b1-1e29630de969/bond-cni-plugin/0.log" Jul 01 19:03:40.214192 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.214168 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qb5z2_37844ed1-4709-4e55-95b1-1e29630de969/routeoverride-cni/0.log" Jul 01 19:03:40.243708 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.243682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qb5z2_37844ed1-4709-4e55-95b1-1e29630de969/whereabouts-cni-bincopy/0.log" Jul 01 19:03:40.271325 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.271303 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qb5z2_37844ed1-4709-4e55-95b1-1e29630de969/whereabouts-cni/0.log" Jul 01 19:03:40.340489 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.340464 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ns9mg_327014f6-05be-4fbe-befe-2161d2ae573e/kube-multus/0.log" Jul 01 19:03:40.462028 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.462002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g5l67_b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6/network-metrics-daemon/0.log" Jul 01 19:03:40.486946 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:40.486921 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g5l67_b92b8cd7-edc3-4ef9-a79d-f9b0dc5445f6/kube-rbac-proxy/0.log" Jul 01 19:03:41.868917 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:41.868889 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-controller/0.log" Jul 01 19:03:41.891566 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:41.891537 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/1.log" Jul 01 19:03:41.891719 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:41.891571 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovn-acl-logging/0.log" Jul 01 19:03:41.912567 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:41.912541 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/kube-rbac-proxy-node/0.log" Jul 01 19:03:41.942054 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:41.942029 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 19:03:41.972566 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:41.972541 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/northd/0.log" Jul 01 19:03:41.998376 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:41.998351 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/nbdb/0.log" Jul 01 19:03:42.022259 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:42.022235 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/sbdb/0.log" Jul 01 19:03:42.067194 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:42.067167 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxdj5_b18a49f5-162c-44a8-8a1f-21cc8b59d966/ovnkube-controller/0.log" Jul 01 19:03:43.106225 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:43.106144 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-gstk4_d55de872-2ac6-4c28-8f20-95df15fe6bc0/check-endpoints/0.log" Jul 01 19:03:43.161661 ip-10-0-141-230 kubenswrapper[2565]: I0701 19:03:43.161612 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-76wtw_cb37284c-086a-4da4-ac53-95b2244e4c86/network-check-target-container/0.log"